2024-09-19T06:47:55.326 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T06:47:55.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:47:55.468 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911773' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuVEpNf6v6Y4V9IwTfbchBIuloWz1GM3MLwE0OGITjbSlzTwk/QWKi8p1GKXIKfSaY9tlL45COPYUAmGti5uok= smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCqAgH16MDFbNlHcNiShMf7zG0j6EYJFFViYMjnRHV7snysPh9vtwaU3wTl+R6AJn88htqFBV1Qn4nay7MhCi8E= smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP7HlfThBDzq9nzSuJditnZJtMw6EVM2m+l3v9jQheYu+AO0251F6Io5/8ikeZ1iDH1Fhm9La1zgUzZYCiWAx70= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - check-counter: {} - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T06:47:55.468 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T06:47:55.469 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T06:47:55.469 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T06:47:55.471 INFO:teuthology.task.internal:Checking packages... 2024-09-19T06:47:55.492 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T06:47:55.492 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:47:55.492 INFO:teuthology.packaging:ref: None 2024-09-19T06:47:55.492 INFO:teuthology.packaging:tag: None 2024-09-19T06:47:55.492 INFO:teuthology.packaging:branch: squid 2024-09-19T06:47:55.492 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:47:55.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T06:47:55.726 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T06:47:55.728 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T06:47:55.735 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T06:47:55.735 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T06:47:55.808 INFO:teuthology.task.internal:Saving configuration 2024-09-19T06:47:55.826 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T06:47:55.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T06:47:55.907 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:42:35.862158', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNuVEpNf6v6Y4V9IwTfbchBIuloWz1GM3MLwE0OGITjbSlzTwk/QWKi8p1GKXIKfSaY9tlL45COPYUAmGti5uok='} 2024-09-19T06:47:55.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:42:35.863230', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCqAgH16MDFbNlHcNiShMf7zG0j6EYJFFViYMjnRHV7snysPh9vtwaU3wTl+R6AJn88htqFBV1Qn4nay7MhCi8E='} 2024-09-19T06:47:55.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:42:35.864500', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP7HlfThBDzq9nzSuJditnZJtMw6EVM2m+l3v9jQheYu+AO0251F6Io5/8ikeZ1iDH1Fhm9La1zgUzZYCiWAx70='} 2024-09-19T06:47:55.945 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T06:47:55.952 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T06:47:55.952 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T06:47:55.952 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T06:47:55.953 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T06:47:56.061 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c523d7be0>, signals=[15]) 2024-09-19T06:47:56.061 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T06:47:56.068 INFO:teuthology.task.internal:Opening connections... 2024-09-19T06:47:56.068 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T06:47:56.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:47:56.149 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T06:47:56.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:47:56.226 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-19T06:47:56.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:47:56.302 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T06:47:56.309 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-09-19T06:47:56.327 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-09-19T06:47:56.327 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-09-19T06:47:56.385 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-09-19T06:47:56.385 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-09-19T06:47:56.385 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-09-19T06:47:56.385 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:47:56.385 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:47:56.386 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:47:56.387 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-09-19T06:47:56.412 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-09-19T06:47:56.429 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-09-19T06:47:56.430 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:47:56.487 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:47:56.488 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:47:56.488 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:47:56.488 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-09-19T06:47:56.503 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-19T06:47:56.522 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-19T06:47:56.522 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:47:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-09-19T06:47:56.581 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:47:56.581 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:47:56.581 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:47:56.581 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:47:56.581 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:47:56.581 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:47:56.581 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-19T06:47:56.612 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T06:47:56.622 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T06:47:56.652 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T06:47:56.652 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:47:56.655 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:47:56.657 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:47:56.674 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T06:47:56.681 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T06:47:56.681 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:47:56.712 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:47:56.714 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:47:56.834 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T06:47:56.910 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T06:47:56.923 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T06:47:56.924 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T06:47:56.924 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:47:56.925 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:47:56.925 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:47:56.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:47:56.942 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-19T06:47:56.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:47:56.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:47:56.943 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-19T06:47:56.944 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-19T06:47:57.000 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:47:57.000 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-503.el9.x86_64 2024-09-19T06:47:57.000 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-09-19T06:47:57.001 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:47:57.001 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-503.el9.x86_64 2024-09-19T06:47:57.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-09-19T06:47:57.002 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:47:57.002 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-503.el9.x86_64 2024-09-19T06:47:57.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-09-19T06:48:00.382 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T06:48:01.021 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.3 MB 00:02 2024-09-19T06:48:01.471 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-19T06:48:03.098 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-19T06:48:03.356 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-19T06:48:03.734 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-19T06:48:07.323 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-19T06:48:08.527 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.5 MB 00:00 2024-09-19T06:48:08.849 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-19T06:48:09.590 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.5 MB 00:02 2024-09-19T06:48:09.719 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T06:48:10.489 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-19T06:48:11.382 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-19T06:48:11.678 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T06:48:12.420 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T06:48:15.359 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T06:48:17.340 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:48:17.341 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:48:17.360 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T06:48:17.438 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-19T06:48:17.444 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-19T06:48:17.444 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-19T06:48:17.444 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-19T06:48:17.444 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-19T06:48:17.445 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:48:17.446 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 79 M 2024-09-19T06:48:17.446 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 126 M 2024-09-19T06:48:17.446 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-19T06:48:17.809 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T06:48:18.035 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-19T06:48:18.869 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T06:48:19.367 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:48:19.368 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:48:19.478 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-19T06:48:19.494 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:48:19.495 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 79 M 2024-09-19T06:48:19.496 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 126 M 2024-09-19T06:48:19.496 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-19T06:48:19.652 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-19T06:48:19.673 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:48:19.673 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:48:19.751 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-19T06:48:19.761 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-19T06:48:19.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:48:19.763 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 79 M 2024-09-19T06:48:19.763 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 126 M 2024-09-19T06:48:19.763 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-19T06:48:19.864 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 316 kB/s | 36 kB 00:00 2024-09-19T06:48:19.977 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 393 kB/s | 36 kB 00:00 2024-09-19T06:48:20.386 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T06:48:20.644 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-19T06:48:20.645 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:48:20.645 INFO:teuthology.orchestra.run.smithi046.stdout:Total 25 MB/s | 79 MB 00:03 2024-09-19T06:48:20.828 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-19T06:48:21.095 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-19T06:48:21.095 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:48:21.095 INFO:teuthology.orchestra.run.smithi078.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-19T06:48:21.351 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-19T06:48:21.728 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-19T06:48:21.728 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-19T06:48:21.765 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-09-19T06:48:21.773 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-19T06:48:22.139 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-19T06:48:22.139 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-19T06:48:22.729 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-19T06:48:22.730 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-19T06:48:23.103 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-19T06:48:23.103 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-19T06:48:25.302 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-19T06:48:25.357 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.2 MB/s | 29 MB 00:05 2024-09-19T06:48:25.523 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-19T06:48:25.963 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:48:26.044 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:48:26.254 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:48:26.354 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:48:28.548 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 35 MB 00:08 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:48:28.549 INFO:teuthology.orchestra.run.smithi029.stdout:Total 8.7 MB/s | 79 MB 00:09 2024-09-19T06:48:28.784 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:48:28.914 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:48:29.108 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:48:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:48:29.263 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-19T06:48:29.666 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-19T06:48:29.666 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-19T06:48:30.633 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-19T06:48:30.633 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-19T06:48:33.226 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-19T06:48:33.957 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:48:34.032 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:48:34.063 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:48:34.072 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:48:34.094 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:48:34.217 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:48:36.842 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:48:37.065 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:48:39.101 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:48:39.213 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:48:42.186 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:48:42.229 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:48:47.373 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:17.337 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:17.377 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:17.759 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:17.759 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:49:17.759 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:49:17.759 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:49:18.533 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:18.578 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:18.596 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:18.596 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:49:18.597 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-19T06:49:18.906 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:18.906 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:49:18.906 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:49:18.906 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:49:18.952 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:49:19.074 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:19.074 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:49:19.074 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:49:19.075 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:49:19.075 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:49:19.075 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T06:49:19.075 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:49:19.075 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:49:19.134 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:19.134 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:49:19.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-09-19T06:49:19.167 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 82.el9 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8274670 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:49:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:49:19.169 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:49:19.170 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:49:19.170 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:49:19.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:49:19.747 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:19.747 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:49:19.747 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-19T06:49:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:49:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:49:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:49:19.748 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:49:19.748 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-19T06:49:19.886 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-19T06:49:20.084 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:49:20.209 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:20.209 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:49:20.209 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:49:20.210 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:49:20.210 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:49:20.210 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T06:49:20.210 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:49:20.210 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:49:20.267 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:20.268 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:49:20.269 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 82.el9 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:49:20.300 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8274670 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-09-19T06:49:20.301 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:49:20.302 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:49:20.302 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:49:20.302 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:49:20.302 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-09-19T06:49:20.302 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:49:20.302 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:49:20.303 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:49:20.303 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:49:20.303 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:49:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-09-19T06:49:21.186 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:49:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-19T06:49:21.219 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-19T06:49:21.234 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.3Q5PedA3Ic 2024-09-19T06:49:21.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3Q5PedA3Ic 2024-09-19T06:49:21.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.3Q5PedA3Ic 2024-09-19T06:49:21.449 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.3Q5PedA3Ic is 6KB 2024-09-19T06:49:21.500 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.3Q5PedA3Ic 2024-09-19T06:49:21.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:49:21.578 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:49:21.579 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:49:21.579 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:49:21.579 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:49:21.581 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:49:21.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-19T06:49:22.387 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:49:22.413 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-09-19T06:49:22.422 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-19T06:49:22.438 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.YqRmyEg5EI 2024-09-19T06:49:22.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YqRmyEg5EI 2024-09-19T06:49:22.504 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.YqRmyEg5EI 2024-09-19T06:49:22.641 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.YqRmyEg5EI is 6KB 2024-09-19T06:49:22.690 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.YqRmyEg5EI 2024-09-19T06:49:22.704 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:49:22.774 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:49:22.774 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:49:22.774 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:49:22.774 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:49:22.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:49:22.914 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-09-19T06:49:28.856 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:28.897 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:29.354 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:29.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:49:29.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:49:29.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:49:30.398 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:49:30.398 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:49:30.398 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-19T06:49:30.398 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:30.398 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:49:30.398 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:49:30.399 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:49:30.399 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:49:30.399 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-19T06:49:30.848 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:49:30.956 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:30.956 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:49:30.957 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:49:30.957 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:49:30.957 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:49:30.957 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T06:49:30.957 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:49:30.957 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:49:31.017 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:49:31.017 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:49:31.017 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 82.el9 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8274670 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:49:31.048 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:49:31.049 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:49:31.050 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:49:31.050 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:49:31.050 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:49:31.852 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-09-19T06:49:33.477 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:49:33.502 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-09-19T06:49:33.504 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-19T06:49:33.519 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.Gbsri4HLfE 2024-09-19T06:49:33.520 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Gbsri4HLfE 2024-09-19T06:49:33.594 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.Gbsri4HLfE 2024-09-19T06:49:33.743 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.Gbsri4HLfE is 6KB 2024-09-19T06:49:33.762 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.Gbsri4HLfE 2024-09-19T06:49:33.777 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:49:33.842 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:49:33.842 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:49:33.842 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:49:33.842 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:49:33.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:49:33.986 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-09-19T06:49:51.753 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T06:49:51.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-19T06:49:51.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:49:52.918 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T06:49:52.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T06:49:52.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:50:03.999 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T06:50:04.000 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-19T06:50:04.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:50:27.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-19T06:50:36.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T06:50:36.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:50:51.758 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T06:50:54.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-19T06:51:00.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-19T06:51:00.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:51:01.293 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-19T06:51:01.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-19T06:51:01.732 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:51:01.732 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-19T06:51:01.746 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:51:01.746 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:51:01.746 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:51:01.747 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:51:02.748 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T06:51:02.748 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T06:51:02.834 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-19T06:51:02.861 DEBUG:teuthology.parallel:result is None 2024-09-19T06:51:04.003 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T06:51:06.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T06:51:06.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:51:09.754 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-19T06:51:10.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T06:51:10.159 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:51:10.159 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-19T06:51:10.174 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:51:10.174 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:51:10.174 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:51:10.174 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:51:11.175 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T06:51:11.175 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T06:51:11.263 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-09-19T06:51:11.287 DEBUG:teuthology.parallel:result is None 2024-09-19T06:51:13.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-19T06:51:13.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:51:20.779 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-19T06:51:21.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-19T06:51:21.753 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:51:21.753 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-19T06:51:21.769 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:51:21.770 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:51:21.770 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:51:21.770 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:51:22.770 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T06:51:22.771 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T06:51:22.938 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-09-19T06:51:22.962 DEBUG:teuthology.parallel:result is None 2024-09-19T06:51:22.962 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T06:51:22.970 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T06:51:22.970 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:51:22.972 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:51:22.975 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:51:22.995 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T06:51:23.017 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T06:51:23.067 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T06:51:23.067 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:51:23.070 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:51:23.073 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:51:23.132 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T06:51:23.140 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T06:51:23.141 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:51:23.143 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:51:23.149 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:51:23.176 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:51:23.177 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:51:23.182 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:51:23.188 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:51:23.188 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:51:23.193 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:51:23.195 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T06:51:23.203 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T06:51:23.203 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:51:23.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:51:23.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:51:23.268 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T06:51:23.279 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T06:51:23.279 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:51:23.305 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:51:23.310 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:51:23.326 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:51:23.405 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:51:23.460 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:51:23.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:51:23.586 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:51:23.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:51:23.669 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:51:23.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:51:23.764 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:51:23.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:51:23.895 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:51:23.895 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:51:23.966 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:51:24.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:51:24.075 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:51:24.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:51:24.160 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:51:24.160 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:51:24.226 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-09-19T06:51:24.229 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-09-19T06:51:24.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-19T06:51:24.274 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:51:24.285 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:51:24.314 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:51:24.777 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T06:51:24.785 INFO:teuthology.task.internal:Starting timer... 2024-09-19T06:51:24.785 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T06:51:24.813 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T06:51:24.847 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T06:51:24.847 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-09-19T06:51:24.981 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-09-19T06:51:24.983 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-09-19T06:51:25.055 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-09-19T06:51:25.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-09-19T06:51:25.122 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-09-19T06:51:25.124 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T06:51:25.124 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-09-19T06:51:25.151 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-09-19T06:51:25.151 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-09-19T06:51:25.174 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-09-19T06:51:25.174 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-09-19T06:51:25.198 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-09-19T06:51:25.198 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi078.front.sepia.ceph.com': 'permissive'} 2024-09-19T06:51:25.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:51:25.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:51:25.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:51:25.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:51:25.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:51:25.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:51:25.282 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T06:51:25.282 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:51:25.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:51:25.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:51:25.472 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T06:51:25.483 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T06:51:25.486 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T06:51:25.595 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T06:51:25.606 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T06:51:25.608 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi046.front.sepia.ceph.com,smithi078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:55:24.951 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi078.front.sepia.ceph.com')] 2024-09-19T06:55:24.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-19T06:55:24.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:55:25.036 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-19T06:55:25.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-19T06:55:25.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T06:55:25.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:55:25.199 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-19T06:55:25.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T06:55:25.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-19T06:55:25.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:55:25.359 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-19T06:55:25.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-19T06:55:25.447 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:55:25.457 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:55:25.457 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:55:25.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:55:25.460 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:55:25.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:55:25.463 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:55:25.463 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:55:25.487 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:55:25.491 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:55:25.502 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:55:25.505 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:55:25.518 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:55:25.529 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-09-19T06:55:25.531 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-09-19T06:55:25.533 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:55:25.541 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-09-19T06:55:25.543 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-09-19T06:55:25.556 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:55:25.557 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:55:25.558 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-09-19T06:55:25.569 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-09-19T06:55:25.571 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:55:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:55:25.583 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:55:25.597 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:55:25.629 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:55:25.632 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:55:25.632 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-19T06:55:25.632 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.632 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.632 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.632 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.633 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:55:25.636 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:55:25.637 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-19T06:55:25.637 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.637 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.637 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.637 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.660 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:55:25.663 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:55:25.663 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-19T06:55:25.663 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.663 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.663 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.663 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:55:25.664 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:55:25.671 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:55:25.671 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:55:25.671 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:55:25.672 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:55:25.677 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:55:25.677 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T06:55:25.678 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:55:25.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:55:25.681 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:55:25.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:55:25.682 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:55:25.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:55:25.834 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:55:25.834 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:55:25.839 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:55:25.839 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:55:25.842 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T06:55:25.842 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T06:55:25.944 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:55:25.944 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:55:25.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:55:25.950 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:55:25.950 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:55:25.950 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:55:25.955 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:55:25.956 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:55:25.956 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:55:25.972 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:55:25.972 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:55:25.978 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:55:25.978 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:55:25.981 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T06:55:25.982 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:55:26.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:55:26.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:55:26.047 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:55:26.115 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:55:26.121 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:55:26.122 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:55:26.181 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-09-19T06:55:26.182 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-09-19T06:55:26.186 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-09-19T06:55:26.189 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-09-19T06:55:26.189 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-09-19T06:55:26.190 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-09-19T06:55:26.414 INFO:teuthology.orchestra.run.smithi029.stdout:45 files removed 2024-09-19T06:55:26.419 INFO:teuthology.orchestra.run.smithi078.stdout:45 files removed 2024-09-19T06:55:26.432 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-09-19T06:55:26.442 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:55:26.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:55:26.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T06:55:27.002 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-19T06:55:27.011 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T06:55:27.036 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-19T06:55:27.296 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T06:55:27.302 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T06:55:27.320 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T06:55:27.572 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:55:27.577 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:55:27.596 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T06:55:28.071 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-19T06:55:29.396 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-19T06:55:30.333 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-19T06:55:32.202 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-19T06:55:34.914 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-19T06:55:37.120 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-19T06:55:37.846 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T06:55:39.523 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T06:55:40.083 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 19 kB 00:00 2024-09-19T06:55:41.015 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-19T06:55:41.230 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T06:55:41.861 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T06:55:42.396 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-19T06:55:44.088 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-19T06:55:44.951 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T06:55:46.912 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T06:55:47.551 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T06:55:49.275 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:55:49.275 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:55:49.288 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:55:49.288 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:55:49.289 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:55:49.290 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:55:49.292 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:55:49.294 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:55:49.295 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:55:49.362 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:55:49.385 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:55:49.386 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:55:49.387 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:55:49.388 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:55:49.389 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:55:49.390 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:55:49.391 INFO:teuthology.orchestra.run.smithi029.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:55:49.392 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:55:49.393 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:55:49.394 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:55:49.395 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:55:49.396 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2024-09-19T06:55:49.397 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:55:49.398 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:55:49.398 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-19T06:55:49.398 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================== 2024-09-19T06:55:49.398 INFO:teuthology.orchestra.run.smithi029.stdout:Install 148 Packages 2024-09-19T06:55:49.398 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 8 Packages 2024-09-19T06:55:49.398 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:55:49.399 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 226 M 2024-09-19T06:55:49.399 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-19T06:55:49.838 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:55:49.839 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:55:49.852 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:55:49.853 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:55:49.854 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:55:49.855 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:55:49.857 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:55:49.860 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:55:49.861 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:55:49.930 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-19T06:55:49.949 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:55:49.950 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:55:49.951 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:55:49.952 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:55:49.953 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:55:49.954 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:55:49.955 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:55:49.956 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:55:49.957 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:55:49.958 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:55:49.959 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:55:49.960 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:55:49.961 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout:Install 148 Packages 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 8 Packages 2024-09-19T06:55:49.962 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:55:49.963 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 226 M 2024-09-19T06:55:49.963 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-19T06:55:50.025 INFO:teuthology.orchestra.run.smithi029.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-19T06:55:50.226 INFO:teuthology.orchestra.run.smithi029.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 896 kB 00:00 2024-09-19T06:55:50.368 INFO:teuthology.orchestra.run.smithi029.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T06:55:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T06:55:50.402 INFO:teuthology.orchestra.run.smithi029.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 826 kB/s | 145 kB 00:00 2024-09-19T06:55:50.510 INFO:teuthology.orchestra.run.smithi029.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 2.4 MB 00:00 2024-09-19T06:55:50.628 INFO:teuthology.orchestra.run.smithi029.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.7 MB/s | 1.5 MB 00:00 2024-09-19T06:55:50.677 INFO:teuthology.orchestra.run.smithi046.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 38 kB/s | 6.6 kB 00:00 2024-09-19T06:55:50.787 INFO:teuthology.orchestra.run.smithi029.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T06:55:51.386 INFO:teuthology.orchestra.run.smithi046.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 896 kB 00:00 2024-09-19T06:55:51.477 INFO:teuthology.orchestra.run.smithi046.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T06:55:51.554 INFO:teuthology.orchestra.run.smithi029.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 13 MB/s | 21 MB 00:01 2024-09-19T06:55:51.796 INFO:teuthology.orchestra.run.smithi029.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 11 MB/s | 11 MB 00:01 2024-09-19T06:55:51.822 INFO:teuthology.orchestra.run.smithi029.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 94 kB/s | 25 kB 00:00 2024-09-19T06:55:51.881 INFO:teuthology.orchestra.run.smithi029.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T06:55:51.948 INFO:teuthology.orchestra.run.smithi029.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 404 kB/s | 27 kB 00:00 2024-09-19T06:55:52.015 INFO:teuthology.orchestra.run.smithi029.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 476 kB/s | 32 kB 00:00 2024-09-19T06:55:52.326 INFO:teuthology.orchestra.run.smithi029.stdout:(14/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 9.9 MB/s | 17 MB 00:01 2024-09-19T06:55:52.368 INFO:teuthology.orchestra.run.smithi029.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.1 MB/s | 751 kB 00:00 2024-09-19T06:55:52.402 INFO:teuthology.orchestra.run.smithi029.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T06:55:52.427 INFO:teuthology.orchestra.run.smithi029.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T06:55:52.428 INFO:teuthology.orchestra.run.smithi046.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2024-09-19T06:55:52.495 INFO:teuthology.orchestra.run.smithi029.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T06:55:52.570 INFO:teuthology.orchestra.run.smithi029.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 602 kB/s | 45 kB 00:00 2024-09-19T06:55:52.617 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:55:52.618 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T06:55:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T06:55:52.629 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T06:55:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T06:55:52.632 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T06:55:52.633 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T06:55:52.635 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T06:55:52.636 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T06:55:52.662 INFO:teuthology.orchestra.run.smithi029.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.4 MB/s | 136 kB 00:00 2024-09-19T06:55:52.697 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-19T06:55:52.713 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================== 2024-09-19T06:55:52.713 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-19T06:55:52.713 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================== 2024-09-19T06:55:52.713 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T06:55:52.714 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T06:55:52.715 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T06:55:52.716 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T06:55:52.717 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:55:52.718 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:55:52.719 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T06:55:52.720 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:55:52.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:55:52.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:55:52.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:55:52.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T06:55:52.725 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout:====================================================================================== 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout:Install 148 Packages 2024-09-19T06:55:52.726 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 8 Packages 2024-09-19T06:55:52.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:55:52.727 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 226 M 2024-09-19T06:55:52.727 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-19T06:55:52.746 INFO:teuthology.orchestra.run.smithi029.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T06:55:52.820 INFO:teuthology.orchestra.run.smithi046.stdout:(5/156): ceph-common-19.1.1-361.g2f599a46.el9.x 9.2 MB/s | 21 MB 00:02 2024-09-19T06:55:52.872 INFO:teuthology.orchestra.run.smithi029.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-19T06:55:52.906 INFO:teuthology.orchestra.run.smithi029.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.0 MB/s | 320 kB 00:00 2024-09-19T06:55:52.940 INFO:teuthology.orchestra.run.smithi029.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T06:55:52.961 INFO:teuthology.orchestra.run.smithi046.stdout:(6/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.2 MB/s | 5.4 MB 00:02 2024-09-19T06:55:52.973 INFO:teuthology.orchestra.run.smithi029.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.4 MB/s | 99 kB 00:00 2024-09-19T06:55:52.999 INFO:teuthology.orchestra.run.smithi029.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T06:55:53.045 INFO:teuthology.orchestra.run.smithi046.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 21 MB/s | 4.7 MB 00:00 2024-09-19T06:55:53.058 INFO:teuthology.orchestra.run.smithi029.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:55:53.152 INFO:teuthology.orchestra.run.smithi029.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 341 kB/s | 32 kB 00:00 2024-09-19T06:55:53.220 INFO:teuthology.orchestra.run.smithi046.stdout:(8/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 1.9 MB/s | 1.5 MB 00:00 2024-09-19T06:55:53.261 INFO:teuthology.orchestra.run.smithi029.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-19T06:55:53.279 INFO:teuthology.orchestra.run.smithi046.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 432 kB/s | 25 kB 00:00 2024-09-19T06:55:53.295 INFO:teuthology.orchestra.run.smithi029.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.0 MB/s | 146 kB 00:00 2024-09-19T06:55:53.604 INFO:teuthology.orchestra.run.smithi046.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 19 MB/s | 11 MB 00:00 2024-09-19T06:55:53.654 INFO:teuthology.orchestra.run.smithi046.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T06:55:53.662 INFO:teuthology.orchestra.run.smithi029.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 8.9 MB/s | 3.6 MB 00:00 2024-09-19T06:55:53.675 INFO:teuthology.orchestra.run.smithi078.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 38 kB/s | 6.6 kB 00:00 2024-09-19T06:55:53.707 INFO:teuthology.orchestra.run.smithi046.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 518 kB/s | 27 kB 00:00 2024-09-19T06:55:53.738 INFO:teuthology.orchestra.run.smithi029.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.2 MB/s | 249 kB 00:00 2024-09-19T06:55:53.765 INFO:teuthology.orchestra.run.smithi046.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T06:55:53.796 INFO:teuthology.orchestra.run.smithi029.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 845 kB/s | 49 kB 00:00 2024-09-19T06:55:53.849 INFO:teuthology.orchestra.run.smithi046.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T06:55:53.899 INFO:teuthology.orchestra.run.smithi046.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T06:55:53.950 INFO:teuthology.orchestra.run.smithi046.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T06:55:53.964 INFO:teuthology.orchestra.run.smithi029.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-19T06:55:53.989 INFO:teuthology.orchestra.run.smithi029.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 85 kB/s | 16 kB 00:00 2024-09-19T06:55:54.008 INFO:teuthology.orchestra.run.smithi046.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 8.5 MB/s | 506 kB 00:00 2024-09-19T06:55:54.031 INFO:teuthology.orchestra.run.smithi029.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T06:55:54.075 INFO:teuthology.orchestra.run.smithi078.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.2 MB/s | 896 kB 00:00 2024-09-19T06:55:54.124 INFO:teuthology.orchestra.run.smithi029.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-19T06:55:54.150 INFO:teuthology.orchestra.run.smithi029.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 155 kB/s | 18 kB 00:00 2024-09-19T06:55:54.200 INFO:teuthology.orchestra.run.smithi078.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T06:55:54.309 INFO:teuthology.orchestra.run.smithi046.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-19T06:55:54.359 INFO:teuthology.orchestra.run.smithi046.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 908 kB/s | 45 kB 00:00 2024-09-19T06:55:54.409 INFO:teuthology.orchestra.run.smithi046.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T06:55:54.417 INFO:teuthology.orchestra.run.smithi029.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 273 kB/s | 80 kB 00:00 2024-09-19T06:55:54.460 INFO:teuthology.orchestra.run.smithi046.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T06:55:54.510 INFO:teuthology.orchestra.run.smithi046.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 6.3 MB/s | 320 kB 00:00 2024-09-19T06:55:54.526 INFO:teuthology.orchestra.run.smithi078.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-09-19T06:55:54.560 INFO:teuthology.orchestra.run.smithi046.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T06:55:54.611 INFO:teuthology.orchestra.run.smithi046.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:55:54.618 INFO:teuthology.orchestra.run.smithi078.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.7 MB/s | 2.4 MB 00:00 2024-09-19T06:55:54.661 INFO:teuthology.orchestra.run.smithi046.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T06:55:54.676 INFO:teuthology.orchestra.run.smithi078.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-19T06:55:54.836 INFO:teuthology.orchestra.run.smithi046.stdout:(26/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 18 MB/s | 3.1 MB 00:00 2024-09-19T06:55:54.895 INFO:teuthology.orchestra.run.smithi046.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T06:55:54.953 INFO:teuthology.orchestra.run.smithi046.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 547 kB/s | 32 kB 00:00 2024-09-19T06:55:55.012 INFO:teuthology.orchestra.run.smithi046.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T06:55:55.201 INFO:teuthology.orchestra.run.smithi029.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 14 MB/s | 49 MB 00:03 2024-09-19T06:55:55.235 INFO:teuthology.orchestra.run.smithi029.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 234 kB/s | 191 kB 00:00 2024-09-19T06:55:55.237 INFO:teuthology.orchestra.run.smithi046.stdout:(30/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 16 MB/s | 3.6 MB 00:00 2024-09-19T06:55:55.243 INFO:teuthology.orchestra.run.smithi078.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 7.5 MB/s | 4.7 MB 00:00 2024-09-19T06:55:55.278 INFO:teuthology.orchestra.run.smithi029.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 710 kB/s | 801 kB 00:01 2024-09-19T06:55:55.337 INFO:teuthology.orchestra.run.smithi029.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T06:55:55.371 INFO:teuthology.orchestra.run.smithi029.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T06:55:55.397 INFO:teuthology.orchestra.run.smithi029.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-19T06:55:55.431 INFO:teuthology.orchestra.run.smithi029.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T06:55:55.464 INFO:teuthology.orchestra.run.smithi029.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-19T06:55:55.507 INFO:teuthology.orchestra.run.smithi029.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.5 MB/s | 1.2 MB 00:00 2024-09-19T06:55:55.649 INFO:teuthology.orchestra.run.smithi029.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 753 kB/s | 107 kB 00:00 2024-09-19T06:55:55.688 INFO:teuthology.orchestra.run.smithi046.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-19T06:55:55.699 INFO:teuthology.orchestra.run.smithi029.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-19T06:55:55.746 INFO:teuthology.orchestra.run.smithi046.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T06:55:55.767 INFO:teuthology.orchestra.run.smithi029.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-19T06:55:55.788 INFO:teuthology.orchestra.run.smithi046.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T06:55:55.817 INFO:teuthology.orchestra.run.smithi029.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-19T06:55:55.830 INFO:teuthology.orchestra.run.smithi046.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 395 kB/s | 16 kB 00:00 2024-09-19T06:55:55.868 INFO:teuthology.orchestra.run.smithi029.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-19T06:55:55.869 INFO:teuthology.orchestra.run.smithi078.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 9.0 MB/s | 21 MB 00:02 2024-09-19T06:55:55.880 INFO:teuthology.orchestra.run.smithi046.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T06:55:55.902 INFO:teuthology.orchestra.run.smithi029.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-09-19T06:55:55.927 INFO:teuthology.orchestra.run.smithi029.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 309 kB/s | 18 kB 00:00 2024-09-19T06:55:55.947 INFO:teuthology.orchestra.run.smithi046.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T06:55:55.952 INFO:teuthology.orchestra.run.smithi029.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 220 kB/s | 11 kB 00:00 2024-09-19T06:55:55.990 INFO:teuthology.orchestra.run.smithi046.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 440 kB/s | 18 kB 00:00 2024-09-19T06:55:55.996 INFO:teuthology.orchestra.run.smithi029.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T06:55:56.030 INFO:teuthology.orchestra.run.smithi029.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 160 kB 00:00 2024-09-19T06:55:56.035 INFO:teuthology.orchestra.run.smithi078.stdout:(9/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 17 MB 00:01 2024-09-19T06:55:56.061 INFO:teuthology.orchestra.run.smithi078.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 131 kB/s | 25 kB 00:00 2024-09-19T06:55:56.120 INFO:teuthology.orchestra.run.smithi078.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T06:55:56.132 INFO:teuthology.orchestra.run.smithi046.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-19T06:55:56.178 INFO:teuthology.orchestra.run.smithi078.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T06:55:56.181 INFO:teuthology.orchestra.run.smithi029.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-19T06:55:56.240 INFO:teuthology.orchestra.run.smithi029.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T06:55:56.282 INFO:teuthology.orchestra.run.smithi029.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 2.3 MB/s | 581 kB 00:00 2024-09-19T06:55:56.295 INFO:teuthology.orchestra.run.smithi078.stdout:(13/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 10 MB/s | 11 MB 00:01 2024-09-19T06:55:56.316 INFO:teuthology.orchestra.run.smithi029.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 626 kB/s | 47 kB 00:00 2024-09-19T06:55:56.320 INFO:teuthology.orchestra.run.smithi078.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 224 kB/s | 32 kB 00:00 2024-09-19T06:55:56.340 INFO:teuthology.orchestra.run.smithi046.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 801 kB 00:00 2024-09-19T06:55:56.354 INFO:teuthology.orchestra.run.smithi078.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T06:55:56.387 INFO:teuthology.orchestra.run.smithi078.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T06:55:56.399 INFO:teuthology.orchestra.run.smithi046.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T06:55:56.399 INFO:teuthology.orchestra.run.smithi029.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T06:55:56.413 INFO:teuthology.orchestra.run.smithi078.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T06:55:56.434 INFO:teuthology.orchestra.run.smithi029.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T06:55:56.455 INFO:teuthology.orchestra.run.smithi078.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T06:55:56.459 INFO:teuthology.orchestra.run.smithi029.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 651 kB/s | 38 kB 00:00 2024-09-19T06:55:56.466 INFO:teuthology.orchestra.run.smithi046.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T06:55:56.514 INFO:teuthology.orchestra.run.smithi078.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 774 kB/s | 45 kB 00:00 2024-09-19T06:55:56.589 INFO:teuthology.orchestra.run.smithi078.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T06:55:56.672 INFO:teuthology.orchestra.run.smithi078.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T06:55:56.727 INFO:teuthology.orchestra.run.smithi029.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-19T06:55:56.748 INFO:teuthology.orchestra.run.smithi078.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T06:55:56.773 INFO:teuthology.orchestra.run.smithi078.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 3.1 MB/s | 320 kB 00:00 2024-09-19T06:55:56.791 INFO:teuthology.orchestra.run.smithi046.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-19T06:55:56.798 INFO:teuthology.orchestra.run.smithi078.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T06:55:56.832 INFO:teuthology.orchestra.run.smithi078.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T06:55:56.866 INFO:teuthology.orchestra.run.smithi078.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T06:55:56.875 INFO:teuthology.orchestra.run.smithi046.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-19T06:55:56.933 INFO:teuthology.orchestra.run.smithi078.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-19T06:55:56.992 INFO:teuthology.orchestra.run.smithi046.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T06:55:57.049 INFO:teuthology.orchestra.run.smithi078.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T06:55:57.075 INFO:teuthology.orchestra.run.smithi078.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 224 kB/s | 32 kB 00:00 2024-09-19T06:55:57.084 INFO:teuthology.orchestra.run.smithi046.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-19T06:55:57.108 INFO:teuthology.orchestra.run.smithi078.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T06:55:57.219 INFO:teuthology.orchestra.run.smithi029.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-09-19T06:55:57.226 INFO:teuthology.orchestra.run.smithi046.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-09-19T06:55:57.267 INFO:teuthology.orchestra.run.smithi078.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 19 MB/s | 3.6 MB 00:00 2024-09-19T06:55:57.368 INFO:teuthology.orchestra.run.smithi078.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T06:55:57.460 INFO:teuthology.orchestra.run.smithi078.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 539 kB/s | 49 kB 00:00 2024-09-19T06:55:57.560 INFO:teuthology.orchestra.run.smithi078.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 165 kB/s | 16 kB 00:00 2024-09-19T06:55:57.586 INFO:teuthology.orchestra.run.smithi029.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-09-19T06:55:57.628 INFO:teuthology.orchestra.run.smithi029.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 2.2 MB/s | 910 kB 00:00 2024-09-19T06:55:57.643 INFO:teuthology.orchestra.run.smithi046.stdout:(47/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 17 MB 00:04 2024-09-19T06:55:57.643 INFO:teuthology.orchestra.run.smithi078.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-19T06:55:57.662 INFO:teuthology.orchestra.run.smithi029.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T06:55:57.669 INFO:teuthology.orchestra.run.smithi078.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.6 MB/s | 285 kB 00:00 2024-09-19T06:55:57.702 INFO:teuthology.orchestra.run.smithi078.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T06:55:57.728 INFO:teuthology.orchestra.run.smithi078.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 311 kB/s | 18 kB 00:00 2024-09-19T06:55:57.764 INFO:teuthology.orchestra.run.smithi029.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-09-19T06:55:57.823 INFO:teuthology.orchestra.run.smithi029.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T06:55:57.836 INFO:teuthology.orchestra.run.smithi078.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-19T06:55:57.932 INFO:teuthology.orchestra.run.smithi029.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-09-19T06:55:57.991 INFO:teuthology.orchestra.run.smithi029.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-19T06:55:58.074 INFO:teuthology.orchestra.run.smithi029.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T06:55:58.161 INFO:teuthology.orchestra.run.smithi029.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T06:55:58.209 INFO:teuthology.orchestra.run.smithi029.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-19T06:55:58.259 INFO:teuthology.orchestra.run.smithi029.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T06:55:58.287 INFO:teuthology.orchestra.run.smithi078.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 22 MB/s | 49 MB 00:02 2024-09-19T06:55:58.301 INFO:teuthology.orchestra.run.smithi046.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 641 kB/s | 689 kB 00:01 2024-09-19T06:55:58.318 INFO:teuthology.orchestra.run.smithi029.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T06:55:58.320 INFO:teuthology.orchestra.run.smithi078.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 395 kB/s | 191 kB 00:00 2024-09-19T06:55:58.354 INFO:teuthology.orchestra.run.smithi078.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-19T06:55:58.369 INFO:teuthology.orchestra.run.smithi029.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T06:55:58.396 INFO:teuthology.orchestra.run.smithi078.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T06:55:58.427 INFO:teuthology.orchestra.run.smithi046.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 857 kB/s | 107 kB 00:00 2024-09-19T06:55:58.438 INFO:teuthology.orchestra.run.smithi078.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-19T06:55:58.463 INFO:teuthology.orchestra.run.smithi078.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-19T06:55:58.488 INFO:teuthology.orchestra.run.smithi078.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-19T06:55:58.514 INFO:teuthology.orchestra.run.smithi078.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T06:55:58.539 INFO:teuthology.orchestra.run.smithi078.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T06:55:58.544 INFO:teuthology.orchestra.run.smithi046.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-19T06:55:58.661 INFO:teuthology.orchestra.run.smithi046.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T06:55:58.719 INFO:teuthology.orchestra.run.smithi046.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 876 kB/s | 943 kB 00:01 2024-09-19T06:55:58.770 INFO:teuthology.orchestra.run.smithi046.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-19T06:55:58.887 INFO:teuthology.orchestra.run.smithi046.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 156 kB/s | 18 kB 00:00 2024-09-19T06:55:58.964 INFO:teuthology.orchestra.run.smithi078.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-09-19T06:55:58.995 INFO:teuthology.orchestra.run.smithi046.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-19T06:55:59.053 INFO:teuthology.orchestra.run.smithi029.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-19T06:55:59.114 INFO:teuthology.orchestra.run.smithi078.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-09-19T06:55:59.120 INFO:teuthology.orchestra.run.smithi046.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-19T06:55:59.170 INFO:teuthology.orchestra.run.smithi029.stdout:(82/156): postgresql-server-13.16-1.el9.x86_64. 3.7 MB/s | 5.8 MB 00:01 2024-09-19T06:55:59.181 INFO:teuthology.orchestra.run.smithi078.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-09-19T06:55:59.204 INFO:teuthology.orchestra.run.smithi029.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-19T06:55:59.223 INFO:teuthology.orchestra.run.smithi078.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 84 kB/s | 22 kB 00:00 2024-09-19T06:55:59.229 INFO:teuthology.orchestra.run.smithi046.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-19T06:55:59.313 INFO:teuthology.orchestra.run.smithi029.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-09-19T06:55:59.347 INFO:teuthology.orchestra.run.smithi029.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 222 kB 00:00 2024-09-19T06:55:59.382 INFO:teuthology.orchestra.run.smithi029.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 434 kB/s | 77 kB 00:00 2024-09-19T06:55:59.408 INFO:teuthology.orchestra.run.smithi029.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 448 kB/s | 42 kB 00:00 2024-09-19T06:55:59.429 INFO:teuthology.orchestra.run.smithi046.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-19T06:55:59.441 INFO:teuthology.orchestra.run.smithi029.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 269 kB 00:00 2024-09-19T06:55:59.448 INFO:teuthology.orchestra.run.smithi078.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-09-19T06:55:59.475 INFO:teuthology.orchestra.run.smithi029.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-19T06:55:59.501 INFO:teuthology.orchestra.run.smithi029.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 862 kB/s | 51 kB 00:00 2024-09-19T06:55:59.520 INFO:teuthology.orchestra.run.smithi046.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-09-19T06:55:59.543 INFO:teuthology.orchestra.run.smithi029.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-19T06:55:59.555 INFO:teuthology.orchestra.run.smithi046.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-19T06:55:59.569 INFO:teuthology.orchestra.run.smithi029.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 578 kB/s | 54 kB 00:00 2024-09-19T06:55:59.594 INFO:teuthology.orchestra.run.smithi029.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 821 kB/s | 42 kB 00:00 2024-09-19T06:55:59.620 INFO:teuthology.orchestra.run.smithi029.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 869 kB/s | 44 kB 00:00 2024-09-19T06:55:59.630 INFO:teuthology.orchestra.run.smithi046.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 223 kB/s | 24 kB 00:00 2024-09-19T06:55:59.662 INFO:teuthology.orchestra.run.smithi029.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T06:55:59.664 INFO:teuthology.orchestra.run.smithi046.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-19T06:55:59.687 INFO:teuthology.orchestra.run.smithi029.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 532 kB/s | 36 kB 00:00 2024-09-19T06:55:59.707 INFO:teuthology.orchestra.run.smithi078.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 529 kB/s | 313 kB 00:00 2024-09-19T06:55:59.721 INFO:teuthology.orchestra.run.smithi029.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 803 kB/s | 47 kB 00:00 2024-09-19T06:55:59.732 INFO:teuthology.orchestra.run.smithi078.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 64 kB/s | 18 kB 00:00 2024-09-19T06:55:59.748 INFO:teuthology.orchestra.run.smithi046.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T06:55:59.781 INFO:teuthology.orchestra.run.smithi029.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-19T06:55:59.781 INFO:teuthology.orchestra.run.smithi046.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T06:55:59.806 INFO:teuthology.orchestra.run.smithi029.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 689 kB/s | 58 kB 00:00 2024-09-19T06:55:59.840 INFO:teuthology.orchestra.run.smithi029.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-19T06:55:59.865 INFO:teuthology.orchestra.run.smithi046.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 328 kB/s | 38 kB 00:00 2024-09-19T06:55:59.867 INFO:teuthology.orchestra.run.smithi029.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 64 kB 00:00 2024-09-19T06:55:59.901 INFO:teuthology.orchestra.run.smithi029.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 740 kB/s | 45 kB 00:00 2024-09-19T06:55:59.908 INFO:teuthology.orchestra.run.smithi078.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 56 kB/s | 11 kB 00:00 2024-09-19T06:56:00.002 INFO:teuthology.orchestra.run.smithi029.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-19T06:56:00.069 INFO:teuthology.orchestra.run.smithi029.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-19T06:56:00.111 INFO:teuthology.orchestra.run.smithi029.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T06:56:00.133 INFO:teuthology.orchestra.run.smithi078.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-19T06:56:00.136 INFO:teuthology.orchestra.run.smithi029.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-19T06:56:00.158 INFO:teuthology.orchestra.run.smithi078.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 377 kB/s | 160 kB 00:00 2024-09-19T06:56:00.250 INFO:teuthology.orchestra.run.smithi078.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-09-19T06:56:00.287 INFO:teuthology.orchestra.run.smithi029.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-19T06:56:00.329 INFO:teuthology.orchestra.run.smithi029.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-19T06:56:00.363 INFO:teuthology.orchestra.run.smithi029.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 343 kB/s | 26 kB 00:00 2024-09-19T06:56:00.397 INFO:teuthology.orchestra.run.smithi029.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-19T06:56:00.423 INFO:teuthology.orchestra.run.smithi029.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 522 kB/s | 49 kB 00:00 2024-09-19T06:56:00.457 INFO:teuthology.orchestra.run.smithi029.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-19T06:56:00.507 INFO:teuthology.orchestra.run.smithi029.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T06:56:00.518 INFO:teuthology.orchestra.run.smithi078.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 92 kB/s | 24 kB 00:00 2024-09-19T06:56:00.533 INFO:teuthology.orchestra.run.smithi029.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:56:00.552 INFO:teuthology.orchestra.run.smithi029.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.7 MB/s | 32 kB 00:00 2024-09-19T06:56:00.594 INFO:teuthology.orchestra.run.smithi029.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.8 MB/s | 839 kB 00:00 2024-09-19T06:56:00.619 INFO:teuthology.orchestra.run.smithi029.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 209 kB/s | 14 kB 00:00 2024-09-19T06:56:00.662 INFO:teuthology.orchestra.run.smithi029.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T06:56:00.704 INFO:teuthology.orchestra.run.smithi029.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T06:56:00.726 INFO:teuthology.orchestra.run.smithi078.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-09-19T06:56:00.737 INFO:teuthology.orchestra.run.smithi029.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-19T06:56:00.780 INFO:teuthology.orchestra.run.smithi029.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 5.1 MB/s | 220 kB 00:00 2024-09-19T06:56:00.822 INFO:teuthology.orchestra.run.smithi029.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-19T06:56:00.851 INFO:teuthology.orchestra.run.smithi078.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 838 kB/s | 581 kB 00:00 2024-09-19T06:56:00.877 INFO:teuthology.orchestra.run.smithi078.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 132 kB/s | 47 kB 00:00 2024-09-19T06:56:00.881 INFO:teuthology.orchestra.run.smithi029.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-09-19T06:56:00.915 INFO:teuthology.orchestra.run.smithi029.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 530 kB/s | 18 kB 00:00 2024-09-19T06:56:00.941 INFO:teuthology.orchestra.run.smithi029.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 921 kB/s | 23 kB 00:00 2024-09-19T06:56:00.966 INFO:teuthology.orchestra.run.smithi029.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 769 kB/s | 19 kB 00:00 2024-09-19T06:56:00.992 INFO:teuthology.orchestra.run.smithi029.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 780 kB/s | 20 kB 00:00 2024-09-19T06:56:01.076 INFO:teuthology.orchestra.run.smithi029.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.0 MB/s | 2.0 MB 00:00 2024-09-19T06:56:01.101 INFO:teuthology.orchestra.run.smithi029.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:56:01.145 INFO:teuthology.orchestra.run.smithi029.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 6.7 MB/s | 1.0 MB 00:00 2024-09-19T06:56:01.152 INFO:teuthology.orchestra.run.smithi078.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 140 kB/s | 38 kB 00:00 2024-09-19T06:56:01.179 INFO:teuthology.orchestra.run.smithi029.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-19T06:56:01.205 INFO:teuthology.orchestra.run.smithi029.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 977 kB/s | 58 kB 00:00 2024-09-19T06:56:01.238 INFO:teuthology.orchestra.run.smithi029.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 490 kB/s | 16 kB 00:00 2024-09-19T06:56:01.264 INFO:teuthology.orchestra.run.smithi029.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:56:01.298 INFO:teuthology.orchestra.run.smithi029.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.2 MB/s | 272 kB 00:00 2024-09-19T06:56:01.302 INFO:teuthology.orchestra.run.smithi078.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 508 kB/s | 292 kB 00:00 2024-09-19T06:56:01.323 INFO:teuthology.orchestra.run.smithi029.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 478 kB/s | 28 kB 00:00 2024-09-19T06:56:01.349 INFO:teuthology.orchestra.run.smithi029.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 606 kB/s | 31 kB 00:00 2024-09-19T06:56:01.352 INFO:teuthology.orchestra.run.smithi078.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 376 kB/s | 188 kB 00:00 2024-09-19T06:56:01.374 INFO:teuthology.orchestra.run.smithi029.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T06:56:01.400 INFO:teuthology.orchestra.run.smithi029.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T06:56:01.426 INFO:teuthology.orchestra.run.smithi029.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T06:56:01.459 INFO:teuthology.orchestra.run.smithi029.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-19T06:56:01.494 INFO:teuthology.orchestra.run.smithi029.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-19T06:56:01.527 INFO:teuthology.orchestra.run.smithi029.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-19T06:56:01.555 INFO:teuthology.orchestra.run.smithi029.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 744 kB/s | 20 kB 00:00 2024-09-19T06:56:01.597 INFO:teuthology.orchestra.run.smithi029.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T06:56:01.631 INFO:teuthology.orchestra.run.smithi029.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T06:56:02.028 INFO:teuthology.orchestra.run.smithi029.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-19T06:56:02.132 INFO:teuthology.orchestra.run.smithi029.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 3.4 MB 00:00 2024-09-19T06:56:02.149 INFO:teuthology.orchestra.run.smithi046.stdout:(66/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 5.5 MB/s | 49 MB 00:08 2024-09-19T06:56:02.158 INFO:teuthology.orchestra.run.smithi078.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.9 MB/s | 4.9 MB 00:01 2024-09-19T06:56:02.180 INFO:teuthology.orchestra.run.smithi029.stdout:(149/156): thrift-0.15.0-2.el9.x86_64.rpm 2.7 MB/s | 1.6 MB 00:00 2024-09-19T06:56:02.194 INFO:teuthology.orchestra.run.smithi078.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2024-09-19T06:56:02.262 INFO:teuthology.orchestra.run.smithi078.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-09-19T06:56:02.322 INFO:teuthology.orchestra.run.smithi029.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T06:56:02.398 INFO:teuthology.orchestra.run.smithi029.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.5 MB/s | 3.2 MB 00:00 2024-09-19T06:56:02.423 INFO:teuthology.orchestra.run.smithi029.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 406 kB/s | 41 kB 00:00 2024-09-19T06:56:02.499 INFO:teuthology.orchestra.run.smithi029.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.7 MB/s | 1.8 MB 00:00 2024-09-19T06:56:02.534 INFO:teuthology.orchestra.run.smithi029.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.8 MB/s | 249 kB 00:00 2024-09-19T06:56:02.583 INFO:teuthology.orchestra.run.smithi029.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.5 MB/s | 1.4 MB 00:00 2024-09-19T06:56:02.629 INFO:teuthology.orchestra.run.smithi078.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 317 kB/s | 137 kB 00:00 2024-09-19T06:56:02.750 INFO:teuthology.orchestra.run.smithi029.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 2.4 MB 00:00 2024-09-19T06:56:02.755 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:56:02.755 INFO:teuthology.orchestra.run.smithi029.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-19T06:56:02.832 INFO:teuthology.orchestra.run.smithi046.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.6 MB/s | 4.9 MB 00:03 2024-09-19T06:56:02.845 INFO:teuthology.orchestra.run.smithi078.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.3 MB/s | 910 kB 00:00 2024-09-19T06:56:03.204 INFO:teuthology.orchestra.run.smithi078.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 244 kB/s | 87 kB 00:00 2024-09-19T06:56:03.313 INFO:teuthology.orchestra.run.smithi078.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2024-09-19T06:56:03.572 INFO:teuthology.orchestra.run.smithi046.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2024-09-19T06:56:03.682 INFO:teuthology.orchestra.run.smithi046.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T06:56:03.713 INFO:teuthology.orchestra.run.smithi078.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 4.0 MB/s | 5.8 MB 00:01 2024-09-19T06:56:03.738 INFO:teuthology.orchestra.run.smithi078.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 144 kB/s | 61 kB 00:00 2024-09-19T06:56:04.017 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-19T06:56:04.125 INFO:teuthology.orchestra.run.smithi046.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.0 MB/s | 4.4 MB 00:04 2024-09-19T06:56:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-19T06:56:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-19T06:56:04.241 INFO:teuthology.orchestra.run.smithi046.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 646 kB/s | 910 kB 00:01 2024-09-19T06:56:04.255 INFO:teuthology.orchestra.run.smithi078.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-19T06:56:04.289 INFO:teuthology.orchestra.run.smithi078.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 425 kB/s | 245 kB 00:00 2024-09-19T06:56:04.314 INFO:teuthology.orchestra.run.smithi078.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 431 kB/s | 248 kB 00:00 2024-09-19T06:56:04.441 INFO:teuthology.orchestra.run.smithi046.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 437 kB/s | 87 kB 00:00 2024-09-19T06:56:04.531 INFO:teuthology.orchestra.run.smithi078.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 93 kB/s | 26 kB 00:00 2024-09-19T06:56:04.573 INFO:teuthology.orchestra.run.smithi078.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 74 kB/s | 19 kB 00:00 2024-09-19T06:56:04.806 INFO:teuthology.orchestra.run.smithi078.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 126 kB/s | 35 kB 00:00 2024-09-19T06:56:04.832 INFO:teuthology.orchestra.run.smithi078.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 333 kB/s | 172 kB 00:00 2024-09-19T06:56:05.344 INFO:teuthology.orchestra.run.smithi078.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 437 kB/s | 222 kB 00:00 2024-09-19T06:56:05.981 INFO:teuthology.orchestra.run.smithi046.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 685 kB/s | 1.0 MB 00:01 2024-09-19T06:56:05.981 INFO:teuthology.orchestra.run.smithi046.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 566 kB/s | 61 kB 00:00 2024-09-19T06:56:05.982 INFO:teuthology.orchestra.run.smithi078.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 435 kB/s | 250 kB 00:00 2024-09-19T06:56:05.982 INFO:teuthology.orchestra.run.smithi078.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-09-19T06:56:05.982 INFO:teuthology.orchestra.run.smithi078.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 231 kB/s | 77 kB 00:00 2024-09-19T06:56:05.982 INFO:teuthology.orchestra.run.smithi078.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 105 kB/s | 42 kB 00:00 2024-09-19T06:56:06.092 INFO:teuthology.orchestra.run.smithi078.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 468 kB/s | 269 kB 00:00 2024-09-19T06:56:06.117 INFO:teuthology.orchestra.run.smithi046.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-19T06:56:06.242 INFO:teuthology.orchestra.run.smithi078.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 280 kB/s | 159 kB 00:00 2024-09-19T06:56:06.309 INFO:teuthology.orchestra.run.smithi078.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 530 kB/s | 279 kB 00:00 2024-09-19T06:56:06.451 INFO:teuthology.orchestra.run.smithi078.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 142 kB/s | 51 kB 00:00 2024-09-19T06:56:06.493 INFO:teuthology.orchestra.run.smithi046.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 662 kB/s | 248 kB 00:00 2024-09-19T06:56:06.593 INFO:teuthology.orchestra.run.smithi046.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-09-19T06:56:06.610 INFO:teuthology.orchestra.run.smithi078.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 146 kB/s | 54 kB 00:00 2024-09-19T06:56:06.654 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-19T06:56:06.655 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-19T06:56:06.693 INFO:teuthology.orchestra.run.smithi046.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-09-19T06:56:06.726 INFO:teuthology.orchestra.run.smithi078.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 42 kB 00:00 2024-09-19T06:56:06.768 INFO:teuthology.orchestra.run.smithi046.stdout:(79/156): postgresql-server-13.16-1.el9.x86_64. 1.9 MB/s | 5.8 MB 00:03 2024-09-19T06:56:06.869 INFO:teuthology.orchestra.run.smithi046.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-09-19T06:56:06.968 INFO:teuthology.orchestra.run.smithi078.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 44 kB 00:00 2024-09-19T06:56:06.977 INFO:teuthology.orchestra.run.smithi046.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 606 kB/s | 172 kB 00:00 2024-09-19T06:56:07.235 INFO:teuthology.orchestra.run.smithi078.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 135 kB/s | 36 kB 00:00 2024-09-19T06:56:07.260 INFO:teuthology.orchestra.run.smithi078.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 413 kB/s | 221 kB 00:00 2024-09-19T06:56:07.361 INFO:teuthology.orchestra.run.smithi046.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 654 kB/s | 250 kB 00:00 2024-09-19T06:56:07.578 INFO:teuthology.orchestra.run.smithi078.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 139 kB/s | 47 kB 00:00 2024-09-19T06:56:07.745 INFO:teuthology.orchestra.run.smithi046.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 580 kB/s | 222 kB 00:00 2024-09-19T06:56:07.769 INFO:teuthology.orchestra.run.smithi078.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 598 kB/s | 304 kB 00:00 2024-09-19T06:56:07.928 INFO:teuthology.orchestra.run.smithi078.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 165 kB/s | 58 kB 00:00 2024-09-19T06:56:07.945 INFO:teuthology.orchestra.run.smithi046.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-19T06:56:08.062 INFO:teuthology.orchestra.run.smithi046.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-19T06:56:08.245 INFO:teuthology.orchestra.run.smithi078.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 201 kB/s | 96 kB 00:00 2024-09-19T06:56:08.295 INFO:teuthology.orchestra.run.smithi078.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 174 kB/s | 64 kB 00:00 2024-09-19T06:56:08.412 INFO:teuthology.orchestra.run.smithi078.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-19T06:56:08.529 INFO:teuthology.orchestra.run.smithi046.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-19T06:56:08.596 INFO:teuthology.orchestra.run.smithi078.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 128 kB/s | 45 kB 00:00 2024-09-19T06:56:08.654 INFO:teuthology.orchestra.run.smithi078.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T06:56:08.688 INFO:teuthology.orchestra.run.smithi078.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T06:56:08.713 INFO:teuthology.orchestra.run.smithi078.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-19T06:56:08.821 INFO:teuthology.orchestra.run.smithi046.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 545 kB/s | 159 kB 00:00 2024-09-19T06:56:08.838 INFO:teuthology.orchestra.run.smithi078.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T06:56:08.864 INFO:teuthology.orchestra.run.smithi078.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:56:08.889 INFO:teuthology.orchestra.run.smithi078.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T06:56:08.914 INFO:teuthology.orchestra.run.smithi078.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T06:56:08.939 INFO:teuthology.orchestra.run.smithi078.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-19T06:56:08.979 INFO:teuthology.orchestra.run.smithi046.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.4 MB/s | 5.1 MB 00:02 2024-09-19T06:56:08.981 INFO:teuthology.orchestra.run.smithi078.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T06:56:09.023 INFO:teuthology.orchestra.run.smithi078.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T06:56:09.049 INFO:teuthology.orchestra.run.smithi078.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:56:09.074 INFO:teuthology.orchestra.run.smithi078.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:56:09.088 INFO:teuthology.orchestra.run.smithi046.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-19T06:56:09.099 INFO:teuthology.orchestra.run.smithi078.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T06:56:09.133 INFO:teuthology.orchestra.run.smithi078.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-19T06:56:09.175 INFO:teuthology.orchestra.run.smithi078.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-19T06:56:09.196 INFO:teuthology.orchestra.run.smithi046.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-09-19T06:56:09.200 INFO:teuthology.orchestra.run.smithi078.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-19T06:56:09.226 INFO:teuthology.orchestra.run.smithi078.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-19T06:56:09.288 INFO:teuthology.orchestra.run.smithi046.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 596 kB/s | 279 kB 00:00 2024-09-19T06:56:09.293 INFO:teuthology.orchestra.run.smithi078.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-19T06:56:09.318 INFO:teuthology.orchestra.run.smithi078.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T06:56:09.343 INFO:teuthology.orchestra.run.smithi078.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-19T06:56:09.368 INFO:teuthology.orchestra.run.smithi078.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-19T06:56:09.394 INFO:teuthology.orchestra.run.smithi078.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-19T06:56:09.397 INFO:teuthology.orchestra.run.smithi046.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-19T06:56:09.419 INFO:teuthology.orchestra.run.smithi078.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-19T06:56:09.444 INFO:teuthology.orchestra.run.smithi078.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-19T06:56:09.478 INFO:teuthology.orchestra.run.smithi078.stdout:(128/156): protobuf-compiler-3.14.0-13.el9.x86_ 810 kB/s | 863 kB 00:01 2024-09-19T06:56:09.514 INFO:teuthology.orchestra.run.smithi046.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 378 kB/s | 44 kB 00:00 2024-09-19T06:56:09.520 INFO:teuthology.orchestra.run.smithi078.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-09-19T06:56:09.545 INFO:teuthology.orchestra.run.smithi078.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.3 MB/s | 79 kB 00:00 2024-09-19T06:56:09.571 INFO:teuthology.orchestra.run.smithi078.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-09-19T06:56:09.596 INFO:teuthology.orchestra.run.smithi078.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T06:56:09.621 INFO:teuthology.orchestra.run.smithi078.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-19T06:56:09.646 INFO:teuthology.orchestra.run.smithi078.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:56:09.671 INFO:teuthology.orchestra.run.smithi078.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T06:56:09.697 INFO:teuthology.orchestra.run.smithi078.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-19T06:56:09.722 INFO:teuthology.orchestra.run.smithi078.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T06:56:09.756 INFO:teuthology.orchestra.run.smithi078.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-19T06:56:09.790 INFO:teuthology.orchestra.run.smithi078.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-19T06:56:09.815 INFO:teuthology.orchestra.run.smithi078.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 604 kB/s | 36 kB 00:00 2024-09-19T06:56:09.841 INFO:teuthology.orchestra.run.smithi078.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T06:56:09.866 INFO:teuthology.orchestra.run.smithi078.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:56:09.891 INFO:teuthology.orchestra.run.smithi078.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T06:56:09.897 INFO:teuthology.orchestra.run.smithi046.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 576 kB/s | 221 kB 00:00 2024-09-19T06:56:09.917 INFO:teuthology.orchestra.run.smithi078.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-19T06:56:09.942 INFO:teuthology.orchestra.run.smithi078.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-19T06:56:09.975 INFO:teuthology.orchestra.run.smithi078.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T06:56:10.014 INFO:teuthology.orchestra.run.smithi046.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-19T06:56:10.034 INFO:teuthology.orchestra.run.smithi078.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T06:56:10.132 INFO:teuthology.orchestra.run.smithi046.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-19T06:56:10.234 INFO:teuthology.orchestra.run.smithi078.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.1 MB/s | 16 MB 00:03 2024-09-19T06:56:10.360 INFO:teuthology.orchestra.run.smithi078.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 8.9 MB/s | 3.4 MB 00:00 2024-09-19T06:56:10.444 INFO:teuthology.orchestra.run.smithi078.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-19T06:56:10.494 INFO:teuthology.orchestra.run.smithi078.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 9.0 MB/s | 2.3 MB 00:00 2024-09-19T06:56:10.519 INFO:teuthology.orchestra.run.smithi078.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 546 kB/s | 41 kB 00:00 2024-09-19T06:56:10.553 INFO:teuthology.orchestra.run.smithi078.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T06:56:10.591 INFO:teuthology.orchestra.run.smithi046.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 663 kB/s | 304 kB 00:00 2024-09-19T06:56:10.595 INFO:teuthology.orchestra.run.smithi078.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 7.7 MB/s | 1.8 MB 00:00 2024-09-19T06:56:10.662 INFO:teuthology.orchestra.run.smithi078.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T06:56:10.699 INFO:teuthology.orchestra.run.smithi046.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-19T06:56:10.703 INFO:teuthology.orchestra.run.smithi078.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 1.4 MB 00:00 2024-09-19T06:56:10.709 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:56:10.709 INFO:teuthology.orchestra.run.smithi078.stdout:Total 13 MB/s | 226 MB 00:17 2024-09-19T06:56:10.907 INFO:teuthology.orchestra.run.smithi046.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 459 kB/s | 96 kB 00:00 2024-09-19T06:56:11.108 INFO:teuthology.orchestra.run.smithi046.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-19T06:56:11.216 INFO:teuthology.orchestra.run.smithi046.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 414 kB/s | 45 kB 00:00 2024-09-19T06:56:11.292 INFO:teuthology.orchestra.run.smithi046.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-19T06:56:11.425 INFO:teuthology.orchestra.run.smithi046.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-09-19T06:56:11.492 INFO:teuthology.orchestra.run.smithi046.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-19T06:56:11.534 INFO:teuthology.orchestra.run.smithi046.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T06:56:11.559 INFO:teuthology.orchestra.run.smithi046.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-19T06:56:11.701 INFO:teuthology.orchestra.run.smithi046.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-19T06:56:11.726 INFO:teuthology.orchestra.run.smithi046.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T06:56:11.752 INFO:teuthology.orchestra.run.smithi046.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T06:56:11.777 INFO:teuthology.orchestra.run.smithi046.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T06:56:11.802 INFO:teuthology.orchestra.run.smithi046.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T06:56:11.853 INFO:teuthology.orchestra.run.smithi046.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T06:56:11.895 INFO:teuthology.orchestra.run.smithi046.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T06:56:11.909 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-19T06:56:11.920 INFO:teuthology.orchestra.run.smithi046.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T06:56:11.945 INFO:teuthology.orchestra.run.smithi046.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T06:56:11.971 INFO:teuthology.orchestra.run.smithi046.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-19T06:56:11.996 INFO:teuthology.orchestra.run.smithi046.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T06:56:12.030 INFO:teuthology.orchestra.run.smithi046.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-19T06:56:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-19T06:56:12.063 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-19T06:56:12.063 INFO:teuthology.orchestra.run.smithi046.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T06:56:12.097 INFO:teuthology.orchestra.run.smithi046.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.4 MB/s | 220 kB 00:00 2024-09-19T06:56:12.156 INFO:teuthology.orchestra.run.smithi046.stdout:(121/156): python3-grpcio-1.46.7-10.el9.x86_64. 35 MB/s | 2.0 MB 00:00 2024-09-19T06:56:12.181 INFO:teuthology.orchestra.run.smithi046.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-19T06:56:12.206 INFO:teuthology.orchestra.run.smithi046.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T06:56:12.232 INFO:teuthology.orchestra.run.smithi046.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-19T06:56:12.257 INFO:teuthology.orchestra.run.smithi046.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-19T06:56:12.282 INFO:teuthology.orchestra.run.smithi046.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-19T06:56:12.307 INFO:teuthology.orchestra.run.smithi046.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 785 kB/s | 20 kB 00:00 2024-09-19T06:56:12.349 INFO:teuthology.orchestra.run.smithi046.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-09-19T06:56:12.375 INFO:teuthology.orchestra.run.smithi046.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T06:56:12.400 INFO:teuthology.orchestra.run.smithi046.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T06:56:12.425 INFO:teuthology.orchestra.run.smithi046.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T06:56:12.459 INFO:teuthology.orchestra.run.smithi046.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T06:56:12.484 INFO:teuthology.orchestra.run.smithi046.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-19T06:56:12.509 INFO:teuthology.orchestra.run.smithi046.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T06:56:12.535 INFO:teuthology.orchestra.run.smithi046.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T06:56:12.560 INFO:teuthology.orchestra.run.smithi046.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-19T06:56:12.585 INFO:teuthology.orchestra.run.smithi046.stdout:(137/156): python3-routes-2.5.1-5.el9.noarch.rp 7.3 MB/s | 188 kB 00:00 2024-09-19T06:56:12.619 INFO:teuthology.orchestra.run.smithi046.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-19T06:56:12.645 INFO:teuthology.orchestra.run.smithi046.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T06:56:12.678 INFO:teuthology.orchestra.run.smithi046.stdout:(140/156): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-19T06:56:12.703 INFO:teuthology.orchestra.run.smithi046.stdout:(141/156): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-19T06:56:12.729 INFO:teuthology.orchestra.run.smithi046.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T06:56:12.762 INFO:teuthology.orchestra.run.smithi046.stdout:(143/156): python3-werkzeug-2.0.3-3.el9.1.noarc 12 MB/s | 427 kB 00:00 2024-09-19T06:56:12.788 INFO:teuthology.orchestra.run.smithi046.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 796 kB/s | 20 kB 00:00 2024-09-19T06:56:12.864 INFO:teuthology.orchestra.run.smithi046.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T06:56:13.157 INFO:teuthology.orchestra.run.smithi046.stdout:(146/156): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-19T06:56:13.489 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-19T06:56:13.639 INFO:teuthology.orchestra.run.smithi046.stdout:(147/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-19T06:56:13.666 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:56:13.698 INFO:teuthology.orchestra.run.smithi046.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 3.4 MB 00:00 2024-09-19T06:56:13.726 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:56:13.781 INFO:teuthology.orchestra.run.smithi046.stdout:(149/156): python3-babel-2.9.1-2.el9.noarch.rpm 654 kB/s | 6.0 MB 00:09 2024-09-19T06:56:13.786 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:56:13.836 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:56:13.870 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:56:13.934 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:56:14.148 INFO:teuthology.orchestra.run.smithi046.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.2 MB/s | 3.2 MB 00:00 2024-09-19T06:56:14.232 INFO:teuthology.orchestra.run.smithi046.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-09-19T06:56:14.290 INFO:teuthology.orchestra.run.smithi046.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T06:56:14.297 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:56:14.307 INFO:teuthology.orchestra.run.smithi046.stdout:(153/156): NetworkManager-team-1.51.0-1.el9.x86 258 kB/s | 41 kB 00:00 2024-09-19T06:56:14.333 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-19T06:56:14.333 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-19T06:56:14.491 INFO:teuthology.orchestra.run.smithi046.stdout:(154/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.9 MB/s | 2.3 MB 00:00 2024-09-19T06:56:14.508 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:56:14.524 INFO:teuthology.orchestra.run.smithi046.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.8 MB/s | 1.4 MB 00:00 2024-09-19T06:56:14.641 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:56:14.677 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:56:14.778 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:56:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:56:15.012 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:56:15.083 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:56:15.111 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:56:15.141 INFO:teuthology.orchestra.run.smithi046.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 2.4 MB 00:00 2024-09-19T06:56:15.146 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:56:15.146 INFO:teuthology.orchestra.run.smithi046.stdout:Total 9.0 MB/s | 226 MB 00:25 2024-09-19T06:56:15.236 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:56:15.263 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:56:15.326 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:56:15.357 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:56:15.380 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:56:15.588 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:56:15.823 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:56:15.988 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:56:16.127 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:16.292 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:16.403 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-19T06:56:16.559 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:16.572 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-19T06:56:16.572 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-19T06:56:16.689 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:56:16.791 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:56:16.834 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:56:16.878 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:56:16.963 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:56:17.023 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:56:17.071 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:56:17.118 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:56:17.181 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:56:17.220 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:56:17.301 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:56:17.362 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:56:17.400 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:56:17.446 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:56:17.534 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:56:17.575 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:56:17.619 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:56:17.655 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:56:17.738 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:56:17.797 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:56:17.878 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:56:18.031 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:56:18.088 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:56:18.651 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:56:18.747 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:56:18.791 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:56:18.835 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:56:18.882 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:56:18.890 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-19T06:56:18.891 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-19T06:56:18.933 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:56:19.150 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:56:19.215 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:56:19.271 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:56:19.936 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:56:19.979 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:56:20.024 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:56:20.081 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:56:20.124 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:56:20.177 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:56:20.229 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:56:20.389 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:56:20.590 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-19T06:56:20.700 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:56:20.716 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:56:20.765 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:56:20.825 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:56:20.866 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:56:20.886 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:56:20.900 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:56:20.949 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:56:21.003 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:56:21.060 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:56:21.125 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:56:21.161 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:56:21.195 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:56:21.331 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:56:21.355 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:56:21.475 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:56:21.517 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:56:21.554 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:56:21.589 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:56:21.593 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:56:21.645 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:56:21.685 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:56:21.714 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:56:21.726 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:56:21.752 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:56:21.761 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:56:21.795 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:56:21.837 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:56:21.843 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:56:21.873 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:56:21.880 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:56:21.970 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:56:22.020 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:56:22.039 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:56:22.070 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:56:22.087 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:56:22.114 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:56:22.186 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:56:22.219 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:56:22.249 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:56:22.249 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:56:22.312 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:56:22.333 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:56:22.357 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:56:22.552 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:56:22.720 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:56:22.848 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:56:22.956 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:23.019 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:56:23.049 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:23.083 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:56:23.123 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:56:23.235 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:56:23.270 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:23.297 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:56:23.351 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:56:23.379 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:56:23.453 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:56:23.476 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:56:23.498 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:56:23.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:56:23.539 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:56:23.605 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:56:23.648 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:56:23.680 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:56:23.690 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:56:23.721 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:56:23.724 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:56:23.757 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:56:23.784 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:56:23.809 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:56:23.853 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:56:23.914 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:56:23.953 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:56:23.998 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:56:24.073 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:56:24.109 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:56:24.152 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:56:24.181 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:56:24.252 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:56:24.295 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:56:24.379 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:56:24.510 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:56:24.520 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:56:24.574 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:56:24.648 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:56:25.095 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:56:25.177 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:56:25.206 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:56:25.258 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:56:25.296 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:56:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:56:25.433 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-19T06:56:25.503 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:56:25.564 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T06:56:25.590 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:56:25.620 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T06:56:25.645 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:56:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T06:56:25.715 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T06:56:25.718 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:56:25.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T06:56:25.758 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:56:25.793 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T06:56:25.802 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:56:25.848 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:56:25.885 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:56:25.928 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:56:25.970 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:56:25.984 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:56:26.108 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:56:26.149 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T06:56:26.166 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:56:26.274 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:56:26.330 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:56:26.332 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:56:26.369 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:56:26.382 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:56:26.413 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:56:26.417 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:56:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:56:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:56:26.566 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:56:26.601 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:56:26.633 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:56:26.665 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:56:26.690 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:56:26.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T06:56:26.787 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:56:26.794 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:56:26.803 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T06:56:26.838 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:56:26.860 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:56:26.917 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:56:26.944 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:56:26.947 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:56:26.961 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:56:26.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:56:26.976 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:56:27.000 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:56:27.013 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:56:27.035 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T06:56:27.049 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:56:27.057 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:56:27.065 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:56:27.080 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:56:27.092 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T06:56:27.110 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:56:27.145 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:56:27.178 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:56:27.220 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:56:27.246 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:56:27.251 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:56:27.333 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:56:27.376 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:56:27.406 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T06:56:27.407 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:56:27.512 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:56:27.522 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T06:56:27.566 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:56:27.580 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:56:27.618 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:56:27.631 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:27.707 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:56:27.740 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:27.745 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:56:27.954 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T06:56:28.065 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T06:56:28.162 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T06:56:28.195 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T06:56:28.239 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T06:56:28.284 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:56:28.331 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T06:56:28.339 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:56:28.373 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:56:28.382 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T06:56:28.430 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T06:56:28.470 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:56:28.482 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T06:56:28.515 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T06:56:28.527 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:56:28.542 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T06:56:28.572 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:56:28.614 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T06:56:28.662 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:56:28.666 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T06:56:28.692 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:56:28.704 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T06:56:28.748 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T06:56:28.827 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T06:56:28.858 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T06:56:28.866 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:56:28.898 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:56:28.902 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T06:56:28.938 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T06:56:28.975 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:56:29.021 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T06:56:29.079 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T06:56:29.157 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T06:56:29.303 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T06:56:29.357 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T06:56:29.622 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:56:29.737 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:56:29.912 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T06:56:29.996 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T06:56:30.031 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T06:56:30.074 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T06:56:30.120 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T06:56:30.159 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:30.163 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T06:56:30.207 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:30.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T06:56:30.415 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T06:56:30.479 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T06:56:30.554 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T06:56:30.599 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T06:56:30.635 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T06:56:30.683 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T06:56:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T06:56:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T06:56:30.797 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T06:56:30.848 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:56:30.949 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:56:30.949 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:56:30.950 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:56:30.950 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:30.956 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T06:56:30.994 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:56:31.001 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:56:31.005 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T06:56:31.047 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T06:56:31.094 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:56:31.122 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:56:31.155 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:56:31.156 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T06:56:31.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T06:56:31.237 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T06:56:31.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T06:56:31.295 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T06:56:31.381 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T06:56:31.462 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:56:31.501 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:56:31.514 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T06:56:31.547 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T06:56:31.590 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:56:31.598 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T06:56:31.622 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:56:31.641 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T06:56:31.658 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:56:31.683 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T06:56:31.732 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T06:56:31.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T06:56:31.820 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T06:56:31.853 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T06:56:31.896 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T06:56:31.938 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T06:56:32.028 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T06:56:32.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T06:56:32.116 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T06:56:32.128 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:56:32.154 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:56:32.225 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:56:32.225 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T06:56:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:56:32.279 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T06:56:33.033 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T06:56:33.089 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T06:56:33.123 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T06:56:33.226 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T06:56:33.280 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T06:56:33.341 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T06:56:33.431 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T06:56:33.469 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T06:56:33.660 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T06:56:33.700 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T06:56:33.781 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T06:56:34.471 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T06:56:34.576 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:34.588 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T06:56:34.610 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:35.157 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:35.200 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:56:35.286 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:56:35.287 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:56:35.287 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:56:35.287 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:35.316 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:56:35.942 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T06:56:36.037 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T06:56:36.065 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T06:56:36.098 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T06:56:36.427 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T06:56:36.551 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:56:36.570 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T06:56:36.599 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T06:56:36.636 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T06:56:37.155 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T06:56:37.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:56:37.261 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T06:56:37.291 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T06:56:39.650 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:39.687 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:40.274 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T06:56:40.324 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:56:40.415 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T06:56:40.415 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:56:40.416 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:56:40.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:40.458 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:56:46.867 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:56:46.867 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-09-19T06:56:46.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:47.044 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:56:47.060 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:56:47.060 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:47.060 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:56:47.060 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-09-19T06:56:47.192 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-09-19T06:56:47.193 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:47.384 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:56:47.401 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:56:47.402 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:47.402 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:56:47.402 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:48.523 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:56:48.549 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:56:48.549 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:48.549 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:56:48.549 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:56:48.549 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:56:48.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:48.773 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:56:48.796 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:56:48.796 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:48.796 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:56:48.796 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:56:48.797 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:56:48.797 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:48.949 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:56:48.978 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:56:48.978 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:48.979 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:56:48.979 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:56:48.979 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:56:48.979 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:49.228 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:56:49.232 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:56:49.253 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:56:49.254 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:49.254 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:56:49.254 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:56:49.254 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:56:49.254 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:49.255 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:56:49.255 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:49.255 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:56:49.255 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:56:49.255 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:56:49.255 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:49.362 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:56:49.419 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:56:49.474 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:56:49.659 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:56:49.707 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:56:49.722 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:56:49.748 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:56:49.748 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:49.748 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:56:49.748 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:56:49.748 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:56:49.748 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:49.778 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:56:49.865 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:56:49.872 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:56:49.931 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:56:49.997 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:56:50.003 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:56:50.051 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:56:50.081 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:56:50.109 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:56:50.206 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:56:50.273 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:56:50.354 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:56:50.462 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:56:50.563 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:56:50.600 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:56:50.613 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:56:50.631 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:56:50.671 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:56:50.693 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:56:50.719 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:56:50.722 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:56:50.755 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:56:51.251 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:56:51.301 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:56:51.342 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:56:51.416 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:56:51.450 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:56:51.768 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:56:51.802 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:56:52.563 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:56:52.629 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T06:56:52.629 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-09-19T06:56:52.629 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-09-19T06:56:52.629 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-09-19T06:56:52.629 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-09-19T06:56:52.630 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-09-19T06:56:52.630 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-09-19T06:56:52.630 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-09-19T06:56:52.630 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:52.630 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:56:52.763 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:56:52.809 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:56:52.813 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:56:52.829 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T06:56:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:52.830 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T06:56:52.830 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:52.910 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:56:53.071 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:56:53.110 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:56:53.133 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:56:53.133 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:53.134 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:56:53.134 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:56:53.134 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:56:53.134 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:53.177 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:56:53.189 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:56:53.287 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:56:53.340 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:56:53.644 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:56:53.681 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:56:53.792 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:56:53.969 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:56:54.011 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:56:54.037 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:56:54.037 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.037 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:56:54.037 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:56:54.037 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:56:54.038 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:54.095 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:56:54.107 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:56:54.217 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:56:54.270 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:56:54.279 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:56:54.297 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:56:54.320 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:56:54.320 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.320 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:56:54.320 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:56:54.320 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:56:54.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:54.366 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:56:54.390 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:56:54.394 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:56:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:56:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:56:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:56:54.394 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:54.412 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:56:54.413 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.413 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:56:54.413 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:54.465 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:56:54.488 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:56:54.488 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.488 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:56:54.488 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:56:54.488 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:56:54.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:54.625 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:56:54.651 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:56:54.651 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.651 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:56:54.651 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:56:54.651 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:56:54.651 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:54.790 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:56:54.813 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:56:54.814 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:54.814 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:56:54.814 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:56:54.814 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:56:54.814 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:56:55.118 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:56:55.143 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:56:55.143 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:55.143 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:56:55.143 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:56:55.144 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:56:55.144 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:55.258 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:56:55.278 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:56:55.316 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:56:55.318 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:56:55.344 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:56:55.344 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:55.345 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:56:55.345 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:56:55.345 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:56:55.345 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:55.380 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:56:55.394 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:56:55.419 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:56:55.419 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:55.419 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:56:55.419 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:55.471 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:56:55.496 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:56:55.496 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:55.496 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:56:55.496 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:56:55.496 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:56:55.496 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:55.575 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:56:55.628 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:56:55.709 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:56:55.822 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:56:55.824 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:56:55.848 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:56:55.848 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:55.848 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:56:55.848 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:56:55.848 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:56:55.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:56:55.967 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:56:56.021 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:56:56.052 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:56:56.079 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:56:56.459 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:56:56.489 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:56:56.518 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:56:56.583 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:56:56.609 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:56:57.722 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:56:57.753 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:56:58.768 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:56:58.803 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:56:58.913 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:56:59.081 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:56:59.114 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:56:59.139 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:56:59.139 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:56:59.139 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:56:59.139 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:56:59.139 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:56:59.139 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:56:59.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:56:59.201 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:56:59.307 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:56:59.352 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:56:59.361 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:56:59.393 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:56:59.434 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:56:59.467 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:56:59.494 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:56:59.683 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:56:59.740 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:56:59.762 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:56:59.797 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:56:59.846 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:57:00.341 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:57:00.367 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:57:00.392 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:57:00.392 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:57:00.392 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:57:00.392 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:57:00.392 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:57:00.393 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:57:00.434 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:57:00.439 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:00.458 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:57:00.458 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:57:00.458 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:57:00.458 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:57:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:00.506 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:00.509 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:57:00.534 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:57:00.535 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:57:00.535 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:57:00.535 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:57:00.535 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:57:00.535 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:57:00.716 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:57:00.767 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:57:00.818 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:57:00.861 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:57:00.866 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:57:00.885 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:57:00.885 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:57:00.886 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:57:00.886 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:57:00.886 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:57:00.886 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:57:00.911 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:57:01.136 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:57:01.197 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:57:01.236 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:57:01.275 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:57:01.331 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:57:01.343 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:57:01.441 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:57:01.491 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:57:01.600 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:57:01.635 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:57:01.669 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:57:01.704 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:57:01.787 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:57:01.788 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:57:01.872 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:57:01.897 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:57:01.902 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:01.902 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:02.024 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:02.081 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:02.084 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:02.084 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:57:02.103 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:02.201 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:57:02.264 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:03.010 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:57:03.133 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:57:03.190 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:57:03.296 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:57:03.341 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:57:03.375 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:57:03.418 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:57:03.418 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:57:03.511 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:57:03.512 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:57:03.606 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:57:03.640 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:57:03.646 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:03.646 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:03.835 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:03.835 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:57:03.945 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:57:04.022 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:05.732 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:57:05.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:57:05.814 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:57:05.845 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:57:05.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:57:06.084 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:57:06.136 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:57:06.166 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:57:06.196 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:57:06.234 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:57:06.879 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:06.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:06.945 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:57:07.845 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:57:07.936 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:57:07.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:57:08.077 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:08.077 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:57:08.077 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:57:08.078 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:57:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:57:08.080 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:57:08.080 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:57:08.087 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:57:08.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:57:08.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:57:08.092 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:57:08.093 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:57:08.094 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:57:08.095 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:57:08.096 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:57:08.097 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:57:08.098 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:57:08.099 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:57:08.100 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:57:08.101 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:57:08.102 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:57:08.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:57:08.103 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:57:08.114 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:57:08.140 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:57:08.174 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:57:08.174 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:57:08.259 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:57:08.259 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:57:08.351 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:57:08.377 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:57:08.382 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:08.382 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:08.569 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:57:08.569 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:57:08.654 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:57:08.722 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:10.932 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:10.933 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.934 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.935 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:57:10.936 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.937 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:57:10.938 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:57:10.939 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:57:10.940 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:57:10.941 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:57:10.942 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.943 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:57:10.944 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:57:10.945 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:57:10.946 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:57:10.946 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:57:10.946 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:57:10.946 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-19T06:57:11.378 DEBUG:teuthology.parallel:result is None 2024-09-19T06:57:14.251 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:14.251 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:57:14.251 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:57:14.251 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:57:14.252 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:57:14.253 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:57:14.254 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:57:14.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:57:14.256 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:57:14.257 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:57:14.258 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:57:14.259 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:57:14.260 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:57:14.261 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:57:14.262 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:57:14.263 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:57:14.264 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:57:14.264 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:57:14.264 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:57:14.264 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:57:14.807 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:14.807 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:57:14.808 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:57:14.809 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:57:14.810 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:57:14.811 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:57:14.812 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:57:14.813 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:57:14.814 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:57:14.815 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:57:14.816 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:57:14.817 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:57:14.818 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:57:14.819 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:57:17.105 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:57:17.106 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.107 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.108 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.109 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:57:17.110 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:57:17.111 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.112 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:57:17.113 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:57:17.114 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:57:17.115 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:57:17.116 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:57:17.117 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:57:17.118 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:57:17.119 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:57:17.119 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T06:57:17.119 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-19T06:57:17.642 DEBUG:teuthology.parallel:result is None 2024-09-19T06:57:17.842 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:57:17.842 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:57:17.842 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-09-19T06:57:17.842 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.842 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.842 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.843 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.844 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:57:17.845 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:57:17.846 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:57:17.846 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:57:17.846 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:57:17.846 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:57:17.846 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:57:17.846 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.847 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:57:17.848 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:57:17.849 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:57:17.850 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:57:17.851 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:57:17.852 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:57:17.853 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:57:17.854 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:57:17.855 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:57:17.856 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:57:17.856 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-19T06:57:18.386 DEBUG:teuthology.parallel:result is None 2024-09-19T06:57:18.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:57:18.533 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:57:18.556 INFO:teuthology.orchestra.run.smithi029.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:57:18.556 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:57:18.556 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:57:18.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:57:18.701 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:57:18.728 INFO:teuthology.orchestra.run.smithi046.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:57:18.728 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:57:18.728 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:57:18.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:57:18.868 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:57:18.896 INFO:teuthology.orchestra.run.smithi078.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:57:18.896 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:57:18.896 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:57:18.898 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:57:18.898 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:57:18.898 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:57:18.927 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:57:18.927 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:57:18.962 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:57:18.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:57:18.994 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:57:18.995 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:57:18.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:57:19.022 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:57:19.090 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:57:19.090 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:57:19.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:57:19.191 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:57:19.191 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:57:19.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:57:19.290 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:57:19.290 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:57:19.291 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:57:19.319 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:57:19.386 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:57:19.386 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:57:19.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:57:19.486 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:57:19.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:57:19.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:57:19.586 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:57:19.586 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:57:19.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:57:19.614 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:57:19.683 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:57:19.683 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:57:19.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:57:19.784 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:57:19.784 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:57:19.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:57:19.883 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T06:57:19.977 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T06:57:19.977 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:57:19.978 INFO:tasks.cephadm:Cluster fsid is 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:57:19.978 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T06:57:19.978 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.29', 'mon.b': '172.21.15.46', 'mon.c': '172.21.15.78'} 2024-09-19T06:57:19.978 INFO:tasks.cephadm:First mon is mon.a on smithi029 2024-09-19T06:57:19.978 INFO:tasks.cephadm:First mgr is x 2024-09-19T06:57:19.978 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T06:57:19.979 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname $(hostname -s) 2024-09-19T06:57:20.010 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-09-19T06:57:20.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname $(hostname -s) 2024-09-19T06:57:20.071 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T06:57:20.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:57:20.213 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T06:57:20.358 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:57:20.360 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:57:20.360 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:57:20.360 DEBUG:teuthology.orchestra.run.smithi029:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:20.741 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:57 /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:20.742 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.114 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:57 /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.114 DEBUG:teuthology.orchestra.run.smithi078:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.473 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:57 /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.473 DEBUG:teuthology.orchestra.run.smithi029:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.494 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.514 DEBUG:teuthology.orchestra.run.smithi078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:57:21.547 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T06:57:21.547 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:57:21.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:57:21.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:57:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:57:23.257 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:57:24.529 INFO:teuthology.orchestra.run.smithi029.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:57:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-19T06:57:50.680 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:57:50.680 INFO:teuthology.orchestra.run.smithi078.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:57:50.680 INFO:teuthology.orchestra.run.smithi078.stdout: "repo_digests": [ 2024-09-19T06:57:50.680 INFO:teuthology.orchestra.run.smithi078.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:57:50.680 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-19T06:57:50.681 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-19T06:57:53.315 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T06:57:53.315 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:57:53.315 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:57:53.316 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-09-19T06:57:53.316 INFO:teuthology.orchestra.run.smithi046.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:57:53.316 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T06:57:53.316 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T06:57:56.460 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T06:57:56.461 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:57:56.461 INFO:teuthology.orchestra.run.smithi029.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:57:56.461 INFO:teuthology.orchestra.run.smithi029.stdout: "repo_digests": [ 2024-09-19T06:57:56.461 INFO:teuthology.orchestra.run.smithi029.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:57:56.461 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T06:57:56.461 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T06:57:56.500 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph 2024-09-19T06:57:56.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-09-19T06:57:56.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph 2024-09-19T06:57:56.717 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /etc/ceph 2024-09-19T06:57:56.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-09-19T06:57:56.774 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /etc/ceph 2024-09-19T06:57:56.802 INFO:tasks.cephadm:Writing seed config... 2024-09-19T06:57:56.803 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T06:57:56.803 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T06:57:56.803 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T06:57:56.804 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T06:57:56.805 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T06:57:56.806 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T06:57:56.807 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T06:57:56.807 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T06:57:56.807 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T06:57:56.807 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T06:57:56.807 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:57:56.808 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T06:57:56.823 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6a046fca-7654-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T06:57:56.823 DEBUG:teuthology.orchestra.run.smithi029:mon.a> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T06:57:56.866 DEBUG:teuthology.orchestra.run.smithi029:mgr.x> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T06:57:56.909 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T06:57:56.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.29 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:57:57.121 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:57:57.121 INFO:teuthology.orchestra.run.smithi029.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '6a046fca-7654-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.29', '--skip-admin-label'] 2024-09-19T06:57:57.121 INFO:teuthology.orchestra.run.smithi029.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T06:57:57.121 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying podman|docker is present... 2024-09-19T06:57:57.156 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:57:57.156 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying lvm2 is present... 2024-09-19T06:57:57.156 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying time synchronization is in place... 2024-09-19T06:57:57.164 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:57:57.164 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:57:57.170 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:57:57.170 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-19T06:57:57.177 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout enabled 2024-09-19T06:57:57.184 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout active 2024-09-19T06:57:57.184 INFO:teuthology.orchestra.run.smithi029.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:57:57.184 INFO:teuthology.orchestra.run.smithi029.stdout:Repeating the final host check... 2024-09-19T06:57:57.206 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi029.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl is present 2024-09-19T06:57:57.207 INFO:teuthology.orchestra.run.smithi029.stdout:lvcreate is present 2024-09-19T06:57:57.213 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:57:57.213 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:57:57.220 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:57:57.220 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-19T06:57:57.227 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout enabled 2024-09-19T06:57:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout active 2024-09-19T06:57:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:57:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:Host looks OK 2024-09-19T06:57:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:Cluster fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:57:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:Acquiring lock 139625839502336 on /run/cephadm/6a046fca-7654-11ef-bceb-c7b262605968.lock 2024-09-19T06:57:57.234 INFO:teuthology.orchestra.run.smithi029.stdout:Lock 139625839502336 acquired on /run/cephadm/6a046fca-7654-11ef-bceb-c7b262605968.lock 2024-09-19T06:57:57.235 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying IP 172.21.15.29 port 3300 ... 2024-09-19T06:57:57.235 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying IP 172.21.15.29 port 6789 ... 2024-09-19T06:57:57.235 INFO:teuthology.orchestra.run.smithi029.stdout:Base mon IP(s) is [172.21.15.29:3300, 172.21.15.29:6789], mon addrv is [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2024-09-19T06:57:57.238 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.29 metric 100 2024-09-19T06:57:57.238 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.29 metric 100 2024-09-19T06:57:57.241 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T06:57:57.241 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T06:57:57.241 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1754sec hoplimit 64 pref medium 2024-09-19T06:57:57.245 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T06:57:57.245 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T06:57:57.246 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:57:57.246 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T06:57:57.246 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-19T06:57:57.246 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:57:57.246 INFO:teuthology.orchestra.run.smithi029.stdout:Mon IP `172.21.15.29` is in CIDR network `172.21.0.0/20` 2024-09-19T06:57:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:Mon IP `172.21.15.29` is in CIDR network `172.21.0.0/20` 2024-09-19T06:57:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T06:57:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T06:57:57.248 INFO:teuthology.orchestra.run.smithi029.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:57:57.690 INFO:teuthology.orchestra.run.smithi029.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T06:57:58.627 INFO:teuthology.orchestra.run.smithi029.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:57:58.627 INFO:teuthology.orchestra.run.smithi029.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:57:58.627 INFO:teuthology.orchestra.run.smithi029.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T06:57:59.656 INFO:teuthology.orchestra.run.smithi029.stdout:stat: stdout 167 167 2024-09-19T06:57:59.656 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial keys... 2024-09-19T06:58:00.679 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQB3y+tm2MDJORAAF/pkyeus+1U+8ldBlTdc7A== 2024-09-19T06:58:01.616 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQB5y+tmDxLPABAAYsDuFzaCj6TPFFYCf64Xfg== 2024-09-19T06:58:09.939 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph-authtool: stdout AQB5y+tmiEnPNxAAOmcmJE+ko+2FgqBxCbXpkQ== 2024-09-19T06:58:09.940 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial monmap... 2024-09-19T06:58:21.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:58:21.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T06:58:21.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:21.552 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:58:21.552 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool for a [v2:172.21.15.29:3300,v1:172.21.15.29:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:58:21.552 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-09-19T06:58:21.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: set fsid to 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:21.553 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:58:21.553 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:58:21.553 INFO:teuthology.orchestra.run.smithi029.stdout:Creating mon... 2024-09-19T06:58:22.583 INFO:teuthology.orchestra.run.smithi029.stdout:create mon.a on 2024-09-19T06:58:22.807 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T06:58:22.952 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T06:58:23.155 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6a046fca-7654-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-6a046fca-7654-11ef-bceb-c7b262605968.target. 2024-09-19T06:58:23.155 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6a046fca-7654-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-6a046fca-7654-11ef-bceb-c7b262605968.target. 2024-09-19T06:58:23.416 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:58:23.416 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T06:58:23.595 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6a046fca-7654-11ef-bceb-c7b262605968.target.wants/ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-6a046fca-7654-11ef-bceb-c7b262605968@.service. 2024-09-19T06:58:24.152 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:58:24.152 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-19T06:58:24.160 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:58:24.160 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-19T06:58:24.161 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-19T06:58:24.161 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:58:24.161 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mon to start... 2024-09-19T06:58:24.161 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mon... 2024-09-19T06:58:24.285 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:24 smithi029 systemd[1]: Started Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: monmap epoch 1 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: last_changed 2024-09-19T06:58:14.453628+0000 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: min_mon_release 19 (squid) 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: election_strategy: 1 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T06:58:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: fsmap 2024-09-19T06:58:25.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:58:25.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:25 smithi029 ceph-mon[30888]: mgrmap e1: no daemons active 2024-09-19T06:58:26.000 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T06:58:26.007 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout id: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:26.007 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T06:58:26.007 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout services: 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 1.3829s) 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout data: 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T06:58:26.008 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.374+0000 7f93da19f640 1 Processor -- start 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.374+0000 7f93da19f640 1 -- start start 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.374+0000 7f93da19f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d410a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.375+0000 7f93da19f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f93d407bdf0 con 0x7f93d4107c70 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.375+0000 7f93d919d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d410a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.375+0000 7f93d919d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d410a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41806/0 (socket says 172.21.15.29:41806) 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.375+0000 7f93d919d640 1 -- 172.21.15.29:0/3466533701 learned_addr learned my addr 172.21.15.29:0/3466533701 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.375+0000 7f93d919d640 1 -- 172.21.15.29:0/3466533701 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d410a5a0 con 0x7f93d4107c70 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.377+0000 7f93d919d640 1 --2- 172.21.15.29:0/3466533701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d410a060 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009820 tx=0x7f93d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1415b9c96c5a2700 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.377+0000 7f93cbfff640 1 -- 172.21.15.29:0/3466533701 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0037070 con 0x7f93d4107c70 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.377+0000 7f93cbfff640 1 -- 172.21.15.29:0/3466533701 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d0032440 con 0x7f93d4107c70 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.377+0000 7f93cbfff640 1 -- 172.21.15.29:0/3466533701 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0032740 con 0x7f93d4107c70 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 -- 172.21.15.29:0/3466533701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 msgr2=0x7f93d410a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 --2- 172.21.15.29:0/3466533701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d410a060 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009820 tx=0x7f93d002a270 comp rx=0 tx=0).stop 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 -- 172.21.15.29:0/3466533701 shutdown_connections 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 --2- 172.21.15.29:0/3466533701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d410a060 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 -- 172.21.15.29:0/3466533701 >> 172.21.15.29:0/3466533701 conn(0x7f93d4101810 msgr2=0x7f93d4103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 -- 172.21.15.29:0/3466533701 shutdown_connections 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.378+0000 7f93da19f640 1 -- 172.21.15.29:0/3466533701 wait complete. 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93da19f640 1 Processor -- start 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93da19f640 1 -- start start 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93da19f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:26.010 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93da19f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f93d410aa80 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93d919d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93d919d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d419ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41816/0 (socket says 172.21.15.29:41816) 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.379+0000 7f93d919d640 1 -- 172.21.15.29:0/1669088747 learned_addr learned my addr 172.21.15.29:0/1669088747 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93d919d640 1 -- 172.21.15.29:0/1669088747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d419b190 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93d919d640 1 --2- 172.21.15.29:0/1669088747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d419ac50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f93d00090b0 tx=0x7f93d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0041070 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d003c7a0 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d419b420 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93d0037040 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d419e110 con 0x7f93d4107c70 2024-09-19T06:58:26.011 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f93d0044070 con 0x7f93d4107c70 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.380+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f93d003d3f0 con 0x7f93d4107c70 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.381+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d41080d0 con 0x7f93d4107c70 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.384+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f93d0046450 con 0x7f93d4107c70 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.445+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f93d402d7c0 con 0x7f93d4107c70 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.446+0000 7f93ca7fc640 1 -- 172.21.15.29:0/1669088747 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+315 (secure 0 0 0) 0x7f93d0046630 con 0x7f93d4107c70 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.446+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 msgr2=0x7f93d419ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.446+0000 7f93da19f640 1 --2- 172.21.15.29:0/1669088747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d419ac50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f93d00090b0 tx=0x7f93d00046c0 comp rx=0 tx=0).stop 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.446+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 shutdown_connections 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.446+0000 7f93da19f640 1 --2- 172.21.15.29:0/1669088747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f93d4107c70 0x7f93d419ac50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.446+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 >> 172.21.15.29:0/1669088747 conn(0x7f93d4101810 msgr2=0x7f93d4102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.447+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 shutdown_connections 2024-09-19T06:58:26.012 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:25.447+0000 7f93da19f640 1 -- 172.21.15.29:0/1669088747 wait complete. 2024-09-19T06:58:26.013 INFO:teuthology.orchestra.run.smithi029.stdout:mon is available 2024-09-19T06:58:26.013 INFO:teuthology.orchestra.run.smithi029.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T06:58:26.257 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:26 smithi029 ceph-mon[30888]: from='client.? 172.21.15.29:0/1669088747' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T06:58:27.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:27 smithi029 ceph-mon[30888]: from='client.? 172.21.15.29:0/1111041367' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:58:27.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:27 smithi029 ceph-mon[30888]: from='client.? 172.21.15.29:0/1111041367' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T06:58:28.217 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:28.217 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:58:28.217 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout fsid = 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:28.217 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:28.218 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.420+0000 7f280e6bf640 1 Processor -- start 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.420+0000 7f280e6bf640 1 -- start start 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.420+0000 7f280e6bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f2808106680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.420+0000 7f280e6bf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2808106c50 con 0x7f2808106280 2024-09-19T06:58:28.219 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.421+0000 7f2807fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f2808106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.421+0000 7f2807fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f2808106680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41820/0 (socket says 172.21.15.29:41820) 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.421+0000 7f2807fff640 1 -- 172.21.15.29:0/2846971997 learned_addr learned my addr 172.21.15.29:0/2846971997 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.421+0000 7f2807fff640 1 -- 172.21.15.29:0/2846971997 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2808107480 con 0x7f2808106280 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f2807fff640 1 --2- 172.21.15.29:0/2846971997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f2808106680 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009820 tx=0x7f27f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d78bf30aef238a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f2806ffd640 1 -- 172.21.15.29:0/2846971997 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8037070 con 0x7f2808106280 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f2806ffd640 1 -- 172.21.15.29:0/2846971997 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f8032440 con 0x7f2808106280 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f2806ffd640 1 -- 172.21.15.29:0/2846971997 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8032740 con 0x7f2808106280 2024-09-19T06:58:28.220 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 -- 172.21.15.29:0/2846971997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 msgr2=0x7f2808106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 --2- 172.21.15.29:0/2846971997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f2808106680 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009820 tx=0x7f27f802a270 comp rx=0 tx=0).stop 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 -- 172.21.15.29:0/2846971997 shutdown_connections 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 --2- 172.21.15.29:0/2846971997 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f2808106680 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 -- 172.21.15.29:0/2846971997 >> 172.21.15.29:0/2846971997 conn(0x7f28081019d0 msgr2=0x7f2808103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 -- 172.21.15.29:0/2846971997 shutdown_connections 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.422+0000 7f280e6bf640 1 -- 172.21.15.29:0/2846971997 wait complete. 2024-09-19T06:58:28.221 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.423+0000 7f280e6bf640 1 Processor -- start 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.423+0000 7f280e6bf640 1 -- start start 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.423+0000 7f280e6bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f280819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.423+0000 7f280e6bf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2808107a20 con 0x7f2808106280 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f2807fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f280819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f2807fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f280819ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41824/0 (socket says 172.21.15.29:41824) 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f2807fff640 1 -- 172.21.15.29:0/1111041367 learned_addr learned my addr 172.21.15.29:0/1111041367 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f2807fff640 1 -- 172.21.15.29:0/1111041367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280819b320 con 0x7f2808106280 2024-09-19T06:58:28.222 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f2807fff640 1 --2- 172.21.15.29:0/1111041367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f280819ade0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f27f80090b0 tx=0x7f27f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8041070 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f803c7a0 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280819b5b0 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f8037040 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.424+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280819ba10 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.425+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f27f8044070 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.425+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27f803d3f0 con 0x7f2808106280 2024-09-19T06:58:28.223 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.425+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2808108070 con 0x7f2808106280 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.428+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f27f8046450 con 0x7f2808106280 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.487+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f280818e650 con 0x7f2808106280 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.490+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f27f8046630 con 0x7f2808106280 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.491+0000 7f28057fa640 1 -- 172.21.15.29:0/1111041367 <== mon.0 v2:172.21.15.29:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f27f8056070 con 0x7f2808106280 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 msgr2=0x7f280819ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 --2- 172.21.15.29:0/1111041367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f280819ade0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f27f80090b0 tx=0x7f27f80046c0 comp rx=0 tx=0).stop 2024-09-19T06:58:28.224 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 shutdown_connections 2024-09-19T06:58:28.225 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 --2- 172.21.15.29:0/1111041367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808106280 0x7f280819ade0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:28.225 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 >> 172.21.15.29:0/1111041367 conn(0x7f28081019d0 msgr2=0x7f28081917e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:28.225 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 shutdown_connections 2024-09-19T06:58:28.225 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:26.492+0000 7f280e6bf640 1 -- 172.21.15.29:0/1111041367 wait complete. 2024-09-19T06:58:28.225 INFO:teuthology.orchestra.run.smithi029.stdout:Generating new minimal ceph.conf... 2024-09-19T06:58:29.085 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:28 smithi029 ceph-mon[30888]: from='client.? 172.21.15.29:0/3331714142' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:58:29.421 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d7d2b640 1 Processor -- start 2024-09-19T06:58:29.421 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d7d2b640 1 -- start start 2024-09-19T06:58:29.421 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d7d2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d0106680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:29.421 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d7d2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0106c50 con 0x7f02d0106280 2024-09-19T06:58:29.421 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d5ac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d0106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:29.421 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d5ac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d0106680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41828/0 (socket says 172.21.15.29:41828) 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.660+0000 7f02d5ac7640 1 -- 172.21.15.29:0/4025438043 learned_addr learned my addr 172.21.15.29:0/4025438043 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.661+0000 7f02d5ac7640 1 -- 172.21.15.29:0/4025438043 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d0107480 con 0x7f02d0106280 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.661+0000 7f02d5ac7640 1 --2- 172.21.15.29:0/4025438043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d0106680 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009820 tx=0x7f02cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3579ef525ab71f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.661+0000 7f02d4ac5640 1 -- 172.21.15.29:0/4025438043 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc037070 con 0x7f02d0106280 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.661+0000 7f02d4ac5640 1 -- 172.21.15.29:0/4025438043 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f02cc0328d0 con 0x7f02d0106280 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d4ac5640 1 -- 172.21.15.29:0/4025438043 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc0307d0 con 0x7f02d0106280 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 -- 172.21.15.29:0/4025438043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 msgr2=0x7f02d0106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 --2- 172.21.15.29:0/4025438043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d0106680 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f02cc009820 tx=0x7f02cc02a270 comp rx=0 tx=0).stop 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 -- 172.21.15.29:0/4025438043 shutdown_connections 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 --2- 172.21.15.29:0/4025438043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d0106680 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 -- 172.21.15.29:0/4025438043 >> 172.21.15.29:0/4025438043 conn(0x7f02d01019d0 msgr2=0x7f02d0103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:29.422 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 -- 172.21.15.29:0/4025438043 shutdown_connections 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.662+0000 7f02d7d2b640 1 -- 172.21.15.29:0/4025438043 wait complete. 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d7d2b640 1 Processor -- start 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d7d2b640 1 -- start start 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d7d2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d01914b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d7d2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f02d010a830 con 0x7f02d0106280 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d5ac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d01914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d5ac7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d01914b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41842/0 (socket says 172.21.15.29:41842) 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.663+0000 7f02d5ac7640 1 -- 172.21.15.29:0/3331714142 learned_addr learned my addr 172.21.15.29:0/3331714142 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02d5ac7640 1 -- 172.21.15.29:0/3331714142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d01919f0 con 0x7f02d0106280 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02d5ac7640 1 --2- 172.21.15.29:0/3331714142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d01914b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f02cc030520 tx=0x7f02cc032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc042070 con 0x7f02d0106280 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f02cc030cc0 con 0x7f02d0106280 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02cc037040 con 0x7f02d0106280 2024-09-19T06:58:29.423 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d018fbe0 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d0190120 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02cc045070 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.664+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02cc047990 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.665+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d010a9b0 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.667+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f02cc03d9c0 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.728+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f02d0106700 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.728+0000 7f02c6ffd640 1 -- 172.21.15.29:0/3331714142 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f02cc047b90 con 0x7f02d0106280 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 msgr2=0x7f02d01914b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 --2- 172.21.15.29:0/3331714142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d01914b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f02cc030520 tx=0x7f02cc032dd0 comp rx=0 tx=0).stop 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 shutdown_connections 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 --2- 172.21.15.29:0/3331714142 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02d0106280 0x7f02d01914b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:29.424 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 >> 172.21.15.29:0/3331714142 conn(0x7f02d01019d0 msgr2=0x7f02d01028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:29.425 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 shutdown_connections 2024-09-19T06:58:29.425 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:28.729+0000 7f02d7d2b640 1 -- 172.21.15.29:0/3331714142 wait complete. 2024-09-19T06:58:29.425 INFO:teuthology.orchestra.run.smithi029.stdout:Restarting the monitor... 2024-09-19T06:58:29.718 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:29 smithi029 systemd[1]: Stopping Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T06:58:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:29 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a[30882]: 2024-09-19T06:58:29.717+0000 7f595e969640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:58:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:29 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a[30882]: 2024-09-19T06:58:29.717+0000 7f595e969640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T06:58:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:29 smithi029 podman[31132]: 2024-09-19 06:58:29.911912901 +0000 UTC m=+0.311381751 container died d7a7f4943eb1628c29ee98dd9649a8aa33cb6c49538994d208ae620d9c970971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:58:30.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 podman[31132]: 2024-09-19 06:58:30.268450513 +0000 UTC m=+0.667919362 container cleanup d7a7f4943eb1628c29ee98dd9649a8aa33cb6c49538994d208ae620d9c970971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:58:30.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 bash[31132]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:58:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 podman[31145]: 2024-09-19 06:58:30.521805349 +0000 UTC m=+0.606777464 container remove d7a7f4943eb1628c29ee98dd9649a8aa33cb6c49538994d208ae620d9c970971 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:58:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T06:58:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 systemd[1]: Stopped Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T06:58:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 systemd[1]: Starting Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 podman[31236]: 2024-09-19 06:58:30.809287548 +0000 UTC m=+0.016418297 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:30 smithi029 podman[31236]: 2024-09-19 06:58:30.906678999 +0000 UTC m=+0.113809731 container create ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 podman[31236]: 2024-09-19 06:58:31.118857186 +0000 UTC m=+0.325987929 container init ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 podman[31236]: 2024-09-19 06:58:31.122151744 +0000 UTC m=+0.329282484 container start ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: pidfile_write: ignore empty --pid-file 2024-09-19T06:58:31.195 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: load: jerasure load: lrc 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Git sha 0 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: DB SUMMARY 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: DB Session ID: A4PLOC2HQCCUOYNQHALF 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103989 ; 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:58:31.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.env: 0x563537ba9940 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.info_log: 0x563539dcb6e0 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.statistics: (nil) 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.use_fsync: 0 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:58:31.197 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.db_log_dir: 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.wal_dir: 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:58:31.198 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.write_buffer_manager: 0x563539ddadc0 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:58:31.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.unordered_write: 0 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.row_cache: None 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.wal_filter: None 2024-09-19T06:58:31.201 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.wal_compression: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:58:31.202 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:58:31.203 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_open_files: -1 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Compression algorithms supported: 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kZSTD supported: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:58:31.204 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.merge_operator: 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_filter: None 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:58:31.205 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563539dcb320) 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: index_type: 0 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: data_block_index_type: 0 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: index_shortening: 1 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: checksum: 4 2024-09-19T06:58:31.206 INFO:journalctl@ceph.mon.a.smithi029.stdout: no_block_cache: 0 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache: 0x563539dbf1f0 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache_options: 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: capacity : 536870912 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: num_shard_bits : 4 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: strict_capacity_limit : 0 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_cache_compressed: (nil) 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: persistent_cache: (nil) 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_size: 4096 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_size_deviation: 10 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_restart_interval: 16 2024-09-19T06:58:31.207 INFO:journalctl@ceph.mon.a.smithi029.stdout: index_block_restart_interval: 1 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: metadata_block_size: 4096 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: partition_filters: 0 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: use_delta_encoding: 1 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: filter_policy: bloomfilter 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: whole_key_filtering: 1 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: verify_compression: 0 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: format_version: 5 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: enable_index_compression: 1 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: block_align: 0 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: max_auto_readahead_size: 262144 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: prepopulate_block_cache: 0 2024-09-19T06:58:31.208 INFO:journalctl@ceph.mon.a.smithi029.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression: NoCompression 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.num_levels: 7 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:58:31.209 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:58:31.210 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:58:31.211 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:58:31.212 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:58:31.213 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.ttl: 2592000 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:58:31.214 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b53a6c74-ebde-4a4e-af15-80c6ed2cb113 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729111148717, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729111149841, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99100, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 97007, "index_size": 285, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 13943, "raw_average_key_size": 49, "raw_value_size": 89387, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726729111, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b53a6c74-ebde-4a4e-af15-80c6ed2cb113", "db_session_id": "A4PLOC2HQCCUOYNQHALF", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729111149942, "job": 1, "event": "recovery_finished"} 2024-09-19T06:58:31.215 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563539dece00 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: DB pointer 0x563539ee8000 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** DB Stats ** 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:58:31.216 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** Compaction Stats [default] ** 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: L0 2/0 98.64 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: Sum 2/0 98.64 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** Compaction Stats [default] ** 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-19T06:58:31.217 INFO:journalctl@ceph.mon.a.smithi029.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Cumulative compaction: 0.00 GB write, 28.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Interval compaction: 0.00 GB write, 28.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Block cache BinnedLRUCache@0x563539dbf1f0#2 capacity: 512.00 MB usage: 1.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-19T06:58:31.218 INFO:journalctl@ceph.mon.a.smithi029.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: starting mon.a rank 0 at public addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] at bind addrs [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???) e1 preinit fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).mds e1 new map 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).mds e1 print_map 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: e1 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: btime 2024-09-19T06:58:24:064353+0000 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: legacy client fscid: -1 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout: No filesystems configured 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:58:31.219 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:58:31.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:58:31.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T06:58:31.220 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 bash[31236]: ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e 2024-09-19T06:58:31.220 INFO:teuthology.orchestra.run.smithi029.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T06:58:31.476 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 systemd[1]: Started Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T06:58:31.476 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:58:31.476 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: monmap epoch 1 2024-09-19T06:58:31.476 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:31.476 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: last_changed 2024-09-19T06:58:14.453628+0000 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: min_mon_release 19 (squid) 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: election_strategy: 1 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: fsmap 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:58:31.477 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:31 smithi029 ceph-mon[31255]: mgrmap e1: no daemons active 2024-09-19T06:58:32.258 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.653+0000 7efcee405640 1 Processor -- start 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.654+0000 7efcee405640 1 -- start start 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.654+0000 7efcee405640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce8106650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.654+0000 7efcee405640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efce8106c20 con 0x7efce8106250 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.654+0000 7efce7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce8106650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.654+0000 7efce7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce8106650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41844/0 (socket says 172.21.15.29:41844) 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.654+0000 7efce7fff640 1 -- 172.21.15.29:0/2998414770 learned_addr learned my addr 172.21.15.29:0/2998414770 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.655+0000 7efce7fff640 1 -- 172.21.15.29:0/2998414770 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce8107450 con 0x7efce8106250 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.656+0000 7efce7fff640 1 --2- 172.21.15.29:0/2998414770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce8106650 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009820 tx=0x7efcd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26364550d15d774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.656+0000 7efce77fe640 1 -- 172.21.15.29:0/2998414770 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8037070 con 0x7efce8106250 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.656+0000 7efce77fe640 1 -- 172.21.15.29:0/2998414770 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efcd80328d0 con 0x7efce8106250 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.656+0000 7efce77fe640 1 -- 172.21.15.29:0/2998414770 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd80307d0 con 0x7efce8106250 2024-09-19T06:58:32.259 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 -- 172.21.15.29:0/2998414770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 msgr2=0x7efce8106650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 --2- 172.21.15.29:0/2998414770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce8106650 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009820 tx=0x7efcd802a270 comp rx=0 tx=0).stop 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 -- 172.21.15.29:0/2998414770 shutdown_connections 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 --2- 172.21.15.29:0/2998414770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce8106650 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 -- 172.21.15.29:0/2998414770 >> 172.21.15.29:0/2998414770 conn(0x7efce81019a0 msgr2=0x7efce8103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 -- 172.21.15.29:0/2998414770 shutdown_connections 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.657+0000 7efcee405640 1 -- 172.21.15.29:0/2998414770 wait complete. 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efcee405640 1 Processor -- start 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efcee405640 1 -- start start 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efcee405640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efcee405640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7efce810a800 con 0x7efce8106250 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efce7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efce7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41856/0 (socket says 172.21.15.29:41856) 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efce7fff640 1 -- 172.21.15.29:0/2299867369 learned_addr learned my addr 172.21.15.29:0/2299867369 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:32.260 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.658+0000 7efce7fff640 1 -- 172.21.15.29:0/2299867369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce819bb70 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efce7fff640 1 --2- 172.21.15.29:0/2299867369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce819b630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097f0 tx=0x7efcd8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd8037040 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7efcd8032bb0 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce819be00 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd803a390 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce819eaf0 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efcd803a580 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.659+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efcd8044b50 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.660+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce810a980 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.662+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efcd8032d60 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.722+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7efce8194d90 con 0x7efce8106250 2024-09-19T06:58:32.261 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.723+0000 7efce5ffb640 1 -- 172.21.15.29:0/2299867369 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7efcd803aa00 con 0x7efce8106250 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 msgr2=0x7efce819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 --2- 172.21.15.29:0/2299867369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce819b630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097f0 tx=0x7efcd8030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 shutdown_connections 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 --2- 172.21.15.29:0/2299867369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efce8106250 0x7efce819b630 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 >> 172.21.15.29:0/2299867369 conn(0x7efce81019a0 msgr2=0x7efce81028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 shutdown_connections 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:31.724+0000 7efcee405640 1 -- 172.21.15.29:0/2299867369 wait complete. 2024-09-19T06:58:32.262 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T06:58:32.276 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:58:32.276 INFO:teuthology.orchestra.run.smithi029.stdout:Creating mgr... 2024-09-19T06:58:32.277 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T06:58:32.278 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T06:58:32.548 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:58:32.548 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T06:58:32.709 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6a046fca-7654-11ef-bceb-c7b262605968.target.wants/ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-6a046fca-7654-11ef-bceb-c7b262605968@.service. 2024-09-19T06:58:33.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:32 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2299867369' entity='client.admin' 2024-09-19T06:58:33.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 podman[31467]: 2024-09-19 06:58:33.122271941 +0000 UTC m=+0.294669974 container create 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:58:33.374 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 podman[31467]: 2024-09-19 06:58:33.336142512 +0000 UTC m=+0.508540505 container init 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:58:33.374 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 podman[31467]: 2024-09-19 06:58:33.3391017 +0000 UTC m=+0.511499692 container start 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:58:33.460 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:58:33.460 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-19T06:58:33.468 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:58:33.468 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-19T06:58:33.468 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-19T06:58:33.468 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:58:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:58:33.477 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-19T06:58:33.485 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:58:33.485 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-19T06:58:33.485 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-19T06:58:33.485 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T06:58:33.485 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr to start... 2024-09-19T06:58:33.485 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr... 2024-09-19T06:58:33.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 bash[31467]: 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce 2024-09-19T06:58:33.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 systemd[1]: Started Ceph mgr.x for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T06:58:33.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:33.464+0000 7fefbbbf1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:58:33.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:33.527+0000 7fefbbbf1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:58:33.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:33.684+0000 7fefbbbf1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:58:34.011 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:33.757+0000 7fefbbbf1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:58:34.011 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:33.913+0000 7fefbbbf1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:58:34.332 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:34 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1046432857' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:58:34.332 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:34.070+0000 7fefbbbf1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:58:34.624 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:34.403+0000 7fefbbbf1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:58:34.624 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:34.466+0000 7fefbbbf1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:58:34.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:34.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:58:34.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "6a046fca-7654-11ef-bceb-c7b262605968", 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:58:34.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:58:34.632 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:58:34.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:58:34.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:58:34.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:58:34.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.640 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:58:24:064353+0000", 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:58:34.641 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:58:34.642 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:58:24.064992+0000", 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.939+0000 7fa8c21c8640 1 Processor -- start 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8c21c8640 1 -- start start 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8c21c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc10a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8c21c8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc075760 con 0x7fa8bc107e00 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc10a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc10a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41888/0 (socket says 172.21.15.29:41888) 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8bb7fe640 1 -- 172.21.15.29:0/1595363211 learned_addr learned my addr 172.21.15.29:0/1595363211 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:34.643 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.940+0000 7fa8bb7fe640 1 -- 172.21.15.29:0/1595363211 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc10a730 con 0x7fa8bc107e00 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.941+0000 7fa8bb7fe640 1 --2- 172.21.15.29:0/1595363211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc10a1f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009820 tx=0x7fa8ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943e5c40433e0fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.941+0000 7fa8baffd640 1 -- 172.21.15.29:0/1595363211 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac037070 con 0x7fa8bc107e00 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.941+0000 7fa8baffd640 1 -- 172.21.15.29:0/1595363211 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa8ac0328d0 con 0x7fa8bc107e00 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.941+0000 7fa8baffd640 1 -- 172.21.15.29:0/1595363211 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac0307d0 con 0x7fa8bc107e00 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.942+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1595363211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 msgr2=0x7fa8bc10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.942+0000 7fa8c21c8640 1 --2- 172.21.15.29:0/1595363211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc10a1f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009820 tx=0x7fa8ac02a270 comp rx=0 tx=0).stop 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.942+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1595363211 shutdown_connections 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.942+0000 7fa8c21c8640 1 --2- 172.21.15.29:0/1595363211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc10a1f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.942+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1595363211 >> 172.21.15.29:0/1595363211 conn(0x7fa8bc1019a0 msgr2=0x7fa8bc103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.943+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1595363211 shutdown_connections 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.943+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1595363211 wait complete. 2024-09-19T06:58:34.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.943+0000 7fa8c21c8640 1 Processor -- start 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.943+0000 7fa8c21c8640 1 -- start start 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8c21c8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8c21c8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc10b710 con 0x7fa8bc107e00 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41894/0 (socket says 172.21.15.29:41894) 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8bb7fe640 1 -- 172.21.15.29:0/1046432857 learned_addr learned my addr 172.21.15.29:0/1046432857 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8bb7fe640 1 -- 172.21.15.29:0/1046432857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc19bb20 con 0x7fa8bc107e00 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8bb7fe640 1 --2- 172.21.15.29:0/1046432857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc19b5e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac032e10 tx=0x7fa8ac032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac042070 con 0x7fa8bc107e00 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa8ac030c80 con 0x7fa8bc107e00 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc19bdb0 con 0x7fa8bc107e00 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.944+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac037040 con 0x7fa8bc107e00 2024-09-19T06:58:34.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.945+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc19eaa0 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.945+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8ac045070 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.945+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa8ac047a40 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.945+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc108260 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:33.948+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa8ac03c700 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.010+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa8bc195190 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.011+0000 7fa8b97fa640 1 -- 172.21.15.29:0/1046432857 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa8ac03c8e0 con 0x7fa8bc107e00 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 msgr2=0x7fa8bc19b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 --2- 172.21.15.29:0/1046432857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc19b5e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac032e10 tx=0x7fa8ac032e40 comp rx=0 tx=0).stop 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 shutdown_connections 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 --2- 172.21.15.29:0/1046432857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8bc107e00 0x7fa8bc19b5e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 >> 172.21.15.29:0/1046432857 conn(0x7fa8bc1019a0 msgr2=0x7fa8bc102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 shutdown_connections 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:34.012+0000 7fa8c21c8640 1 -- 172.21.15.29:0/1046432857 wait complete. 2024-09-19T06:58:34.646 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (1/15)... 2024-09-19T06:58:35.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:34.663+0000 7fefbbbf1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:58:35.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:35 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:35.592+0000 7fefbbbf1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:58:35.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:35 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:35.663+0000 7fefbbbf1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:58:36.692 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:36.420+0000 7fefbbbf1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:58:36.693 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:36.541+0000 7fefbbbf1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:58:36.987 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:36.691+0000 7fefbbbf1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:58:36.987 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:36.755+0000 7fefbbbf1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:58:36.987 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:36.914+0000 7fefbbbf1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:58:36.987 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:36.985+0000 7fefbbbf1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:58:37.292 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1463748507' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:58:37.292 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.049+0000 7fefbbbf1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:58:37.292 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.223+0000 7fefbbbf1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:58:37.292 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.291+0000 7fefbbbf1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:58:37.573 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.360+0000 7fefbbbf1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:58:37.573 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.447+0000 7fefbbbf1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:58:37.573 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.509+0000 7fefbbbf1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:58:37.573 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:37.571+0000 7fefbbbf1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:58:37.905 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "6a046fca-7654-11ef-bceb-c7b262605968", 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:58:37.906 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:58:37.907 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:58:37.915 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:58:37.915 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:58:37.915 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:58:37.915 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.915 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:58:24:064353+0000", 2024-09-19T06:58:37.916 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.917 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:58:24.064992+0000", 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f5788773640 1 Processor -- start 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f5788773640 1 -- start start 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f5788773640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f5780107790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f5788773640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5780107d60 con 0x7f5780107390 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f578650f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f5780107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f578650f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f5780107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39744/0 (socket says 172.21.15.29:39744) 2024-09-19T06:58:37.918 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.095+0000 7f578650f640 1 -- 172.21.15.29:0/1740465207 learned_addr learned my addr 172.21.15.29:0/1740465207 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.096+0000 7f578650f640 1 -- 172.21.15.29:0/1740465207 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5780108590 con 0x7f5780107390 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.096+0000 7f578650f640 1 --2- 172.21.15.29:0/1740465207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f5780107790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f577c009820 tx=0x7f577c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aed00296f989bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f578550d640 1 -- 172.21.15.29:0/1740465207 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c037070 con 0x7f5780107390 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f578550d640 1 -- 172.21.15.29:0/1740465207 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f577c0328d0 con 0x7f5780107390 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f578550d640 1 -- 172.21.15.29:0/1740465207 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c0307d0 con 0x7f5780107390 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 -- 172.21.15.29:0/1740465207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 msgr2=0x7f5780107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 --2- 172.21.15.29:0/1740465207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f5780107790 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f577c009820 tx=0x7f577c02a270 comp rx=0 tx=0).stop 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 -- 172.21.15.29:0/1740465207 shutdown_connections 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 --2- 172.21.15.29:0/1740465207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f5780107790 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 -- 172.21.15.29:0/1740465207 >> 172.21.15.29:0/1740465207 conn(0x7f5780102ae0 msgr2=0x7f5780104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 -- 172.21.15.29:0/1740465207 shutdown_connections 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.097+0000 7f5788773640 1 -- 172.21.15.29:0/1740465207 wait complete. 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f5788773640 1 Processor -- start 2024-09-19T06:58:37.919 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f5788773640 1 -- start start 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f5788773640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f578019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f5788773640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f578010b940 con 0x7f5780107390 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f578650f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f578019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f578650f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f578019b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39758/0 (socket says 172.21.15.29:39758) 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f578650f640 1 -- 172.21.15.29:0/1463748507 learned_addr learned my addr 172.21.15.29:0/1463748507 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.098+0000 7f578650f640 1 -- 172.21.15.29:0/1463748507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578019b7d0 con 0x7f5780107390 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f578650f640 1 --2- 172.21.15.29:0/1463748507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f578019b290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f577c0097f0 tx=0x7f577c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c037040 con 0x7f5780107390 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578019ba60 con 0x7f5780107390 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f577c032bb0 con 0x7f5780107390 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c03a390 con 0x7f5780107390 2024-09-19T06:58:37.920 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578019e750 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f577c03a5d0 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.099+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f577c044ba0 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.100+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5780107810 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.102+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f577c044400 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.164+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f578019ecd0 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.165+0000 7f57777fe640 1 -- 172.21.15.29:0/1463748507 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f577c032d60 con 0x7f5780107390 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.165+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 msgr2=0x7f578019b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.165+0000 7f5788773640 1 --2- 172.21.15.29:0/1463748507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f578019b290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f577c0097f0 tx=0x7f577c030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.165+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 shutdown_connections 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.165+0000 7f5788773640 1 --2- 172.21.15.29:0/1463748507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5780107390 0x7f578019b290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.165+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 >> 172.21.15.29:0/1463748507 conn(0x7f5780102ae0 msgr2=0x7f5780103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.166+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 shutdown_connections 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:37.166+0000 7f5788773640 1 -- 172.21.15.29:0/1463748507 wait complete. 2024-09-19T06:58:37.921 INFO:teuthology.orchestra.run.smithi029.stdout:mgr not available, waiting (2/15)... 2024-09-19T06:58:38.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:38.403+0000 7fefbbbf1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:58:38.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: Activating manager daemon x 2024-09-19T06:58:38.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: mgrmap e2: x(active, starting, since 0.00295585s) 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: Manager daemon x is now available 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' 2024-09-19T06:58:38.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:38 smithi029 ceph-mon[31255]: from='mgr.14100 172.21.15.29:0/3944448788' entity='mgr.x' 2024-09-19T06:58:40.588 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:40 smithi029 ceph-mon[31255]: mgrmap e3: x(active, since 1.00762s) 2024-09-19T06:58:41.161 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:41.161 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:58:41.161 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsid": "6a046fca-7654-11ef-bceb-c7b262605968", 2024-09-19T06:58:41.161 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:58:41.161 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:58:41.161 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:41.162 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:58:41.163 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:58:41.172 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:58:24:064353+0000", 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:58:41.173 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:58:24.064992+0000", 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:58:41.174 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f061b146640 1 Processor -- start 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f061b146640 1 -- start start 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f061b146640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614105a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f061b146640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0614106060 con 0x7f0614105690 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f0618ee2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614105a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f0618ee2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614105a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39838/0 (socket says 172.21.15.29:39838) 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f0618ee2640 1 -- 172.21.15.29:0/1479412963 learned_addr learned my addr 172.21.15.29:0/1479412963 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.329+0000 7f0618ee2640 1 -- 172.21.15.29:0/1479412963 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0614108670 con 0x7f0614105690 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.330+0000 7f0618ee2640 1 --2- 172.21.15.29:0/1479412963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614105a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009820 tx=0x7f05fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fc45a46a91c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.330+0000 7f06137fe640 1 -- 172.21.15.29:0/1479412963 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc037070 con 0x7f0614105690 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.330+0000 7f06137fe640 1 -- 172.21.15.29:0/1479412963 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f05fc0328d0 con 0x7f0614105690 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f06137fe640 1 -- 172.21.15.29:0/1479412963 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0307d0 con 0x7f0614105690 2024-09-19T06:58:41.175 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 -- 172.21.15.29:0/1479412963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 msgr2=0x7f0614105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 --2- 172.21.15.29:0/1479412963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614105a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009820 tx=0x7f05fc02a270 comp rx=0 tx=0).stop 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 -- 172.21.15.29:0/1479412963 shutdown_connections 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 --2- 172.21.15.29:0/1479412963 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614105a90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 -- 172.21.15.29:0/1479412963 >> 172.21.15.29:0/1479412963 conn(0x7f06141011c0 msgr2=0x7f0614103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 -- 172.21.15.29:0/1479412963 shutdown_connections 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.331+0000 7f061b146640 1 -- 172.21.15.29:0/1479412963 wait complete. 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f061b146640 1 Processor -- start 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f061b146640 1 -- start start 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f061b146640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614107ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f061b146640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f061410b8a0 con 0x7f0614105690 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f0618ee2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614107ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:41.176 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f0618ee2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614107ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39848/0 (socket says 172.21.15.29:39848) 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.332+0000 7f0618ee2640 1 -- 172.21.15.29:0/2792389756 learned_addr learned my addr 172.21.15.29:0/2792389756 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f0618ee2640 1 -- 172.21.15.29:0/2792389756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0614108430 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f0618ee2640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614107ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0097f0 tx=0x7f05fc030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc037040 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f05fc032bb0 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0614106620 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc03a390 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.333+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0614106b60 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.334+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f05fc03a580 con 0x7f0614105690 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.335+0000 7f0611ffb640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f06000390a0 0x7f060003b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:41.177 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.335+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0614105b10 con 0x7f0614105690 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.335+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f05fc06c150 con 0x7f0614105690 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.335+0000 7f0613fff640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f06000390a0 0x7f060003b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.335+0000 7f0613fff640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f06000390a0 0x7f060003b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f060400ad30 tx=0x7f06040093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.340+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05fc040210 con 0x7f0614105690 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.411+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f05fc042c20 con 0x7f0614105690 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.587+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0614068540 con 0x7f0614105690 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.588+0000 7f0611ffb640 1 -- 172.21.15.29:0/2792389756 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f05fc06ff00 con 0x7f0614105690 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f06000390a0 msgr2=0x7f060003b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f06000390a0 0x7f060003b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f060400ad30 tx=0x7f06040093f0 comp rx=0 tx=0).stop 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 msgr2=0x7f0614107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614107ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0097f0 tx=0x7f05fc030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 shutdown_connections 2024-09-19T06:58:41.178 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f06000390a0 0x7f060003b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:41.179 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 --2- 172.21.15.29:0/2792389756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0614105690 0x7f0614107ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:41.179 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 >> 172.21.15.29:0/2792389756 conn(0x7f06141011c0 msgr2=0x7f0614101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:41.179 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 shutdown_connections 2024-09-19T06:58:41.179 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:40.591+0000 7f061b146640 1 -- 172.21.15.29:0/2792389756 wait complete. 2024-09-19T06:58:41.179 INFO:teuthology.orchestra.run.smithi029.stdout:mgr is available 2024-09-19T06:58:41.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:41 smithi029 ceph-mon[31255]: mgrmap e4: x(active, since 2s) 2024-09-19T06:58:41.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:41 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2792389756' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:58:42.413 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:42.413 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:58:42.413 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout fsid = 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:42.413 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.29:3300,v1:172.21.15.29:6789] 2024-09-19T06:58:42.413 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:58:42.413 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22ebc15640 1 Processor -- start 2024-09-19T06:58:42.414 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22ebc15640 1 -- start start 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22ebc15640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e4106020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22ebc15640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f22e407be10 con 0x7f22e4105c20 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22e99b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e4106020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22e99b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e4106020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39850/0 (socket says 172.21.15.29:39850) 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.610+0000 7f22e99b1640 1 -- 172.21.15.29:0/4091787356 learned_addr learned my addr 172.21.15.29:0/4091787356 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.611+0000 7f22e99b1640 1 -- 172.21.15.29:0/4091787356 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e4106560 con 0x7f22e4105c20 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.611+0000 7f22e99b1640 1 --2- 172.21.15.29:0/4091787356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e4106020 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009820 tx=0x7f22e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5db7f6363a584fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22e89af640 1 -- 172.21.15.29:0/4091787356 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e0037070 con 0x7f22e4105c20 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22e89af640 1 -- 172.21.15.29:0/4091787356 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f22e00328d0 con 0x7f22e4105c20 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22e89af640 1 -- 172.21.15.29:0/4091787356 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e00307d0 con 0x7f22e4105c20 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 -- 172.21.15.29:0/4091787356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 msgr2=0x7f22e4106020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:42.415 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 --2- 172.21.15.29:0/4091787356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e4106020 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009820 tx=0x7f22e002a270 comp rx=0 tx=0).stop 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 -- 172.21.15.29:0/4091787356 shutdown_connections 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 --2- 172.21.15.29:0/4091787356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e4106020 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 -- 172.21.15.29:0/4091787356 >> 172.21.15.29:0/4091787356 conn(0x7f22e41019d0 msgr2=0x7f22e4103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 -- 172.21.15.29:0/4091787356 shutdown_connections 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.612+0000 7f22ebc15640 1 -- 172.21.15.29:0/4091787356 wait complete. 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22ebc15640 1 Processor -- start 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22ebc15640 1 -- start start 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22ebc15640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e419d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22ebc15640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f22e4107600 con 0x7f22e4105c20 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22e99b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e419d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22e99b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e419d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39854/0 (socket says 172.21.15.29:39854) 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.613+0000 7f22e99b1640 1 -- 172.21.15.29:0/2553461599 learned_addr learned my addr 172.21.15.29:0/2553461599 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:42.416 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22e99b1640 1 -- 172.21.15.29:0/2553461599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e419dd40 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22e99b1640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e419d800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22e00097f0 tx=0x7f22e0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e0037040 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f22e003b3f0 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e419dfd0 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e003a520 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.614+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e41a0cc0 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.615+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f22e003b5a0 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.615+0000 7f22daffd640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f22d00391b0 0x7f22d003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.615+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f22e006c3b0 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.615+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e4106020 con 0x7f22e4105c20 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.615+0000 7f22e91b0640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f22d00391b0 0x7f22d003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.616+0000 7f22e91b0640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f22d00391b0 0x7f22d003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098c0 tx=0x7f22d4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.620+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22e006bdd0 con 0x7f22e4105c20 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.797+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f22e4196000 con 0x7f22e4105c20 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.798+0000 7f22daffd640 1 -- 172.21.15.29:0/2553461599 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f22e003b980 con 0x7f22e4105c20 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f22d00391b0 msgr2=0x7f22d003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f22d00391b0 0x7f22d003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098c0 tx=0x7f22d4006db0 comp rx=0 tx=0).stop 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 msgr2=0x7f22e419d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e419d800 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22e00097f0 tx=0x7f22e0030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 shutdown_connections 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f22d00391b0 0x7f22d003b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 --2- 172.21.15.29:0/2553461599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22e4105c20 0x7f22e419d800 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.800+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 >> 172.21.15.29:0/2553461599 conn(0x7f22e41019d0 msgr2=0x7f22e4194120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.801+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 shutdown_connections 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:41.801+0000 7f22ebc15640 1 -- 172.21.15.29:0/2553461599 wait complete. 2024-09-19T06:58:42.418 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling cephadm module... 2024-09-19T06:58:42.734 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:42 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2553461599' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:58:43.733 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3908053625' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T06:58:43.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: ignoring --setuser ceph since I am not root 2024-09-19T06:58:43.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: ignoring --setgroup ceph since I am not root 2024-09-19T06:58:43.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:43.559+0000 7fd73711c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:58:43.733 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:43.618+0000 7fd73711c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:58:44.001 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:43.776+0000 7fd73711c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:58:44.001 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:43.844+0000 7fd73711c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:58:44.001 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:44.000+0000 7fd73711c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:58:44.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.814+0000 7f6d6a975640 1 Processor -- start 2024-09-19T06:58:44.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.814+0000 7f6d6a975640 1 -- start start 2024-09-19T06:58:44.043 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.814+0000 7f6d6a975640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6410a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.814+0000 7f6d6a975640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64075760 con 0x7f6d64107e00 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.815+0000 7f6d63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6410a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.815+0000 7f6d63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6410a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39860/0 (socket says 172.21.15.29:39860) 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.815+0000 7f6d63fff640 1 -- 172.21.15.29:0/2895970203 learned_addr learned my addr 172.21.15.29:0/2895970203 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.815+0000 7f6d63fff640 1 -- 172.21.15.29:0/2895970203 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6410a730 con 0x7f6d64107e00 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.815+0000 7f6d63fff640 1 --2- 172.21.15.29:0/2895970203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6410a1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009820 tx=0x7f6d5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc11d084fadd238c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d62ffd640 1 -- 172.21.15.29:0/2895970203 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54037070 con 0x7f6d64107e00 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d62ffd640 1 -- 172.21.15.29:0/2895970203 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6d540328d0 con 0x7f6d64107e00 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d62ffd640 1 -- 172.21.15.29:0/2895970203 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d540307d0 con 0x7f6d64107e00 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 -- 172.21.15.29:0/2895970203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 msgr2=0x7f6d6410a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 --2- 172.21.15.29:0/2895970203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6410a1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009820 tx=0x7f6d5402a270 comp rx=0 tx=0).stop 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 -- 172.21.15.29:0/2895970203 shutdown_connections 2024-09-19T06:58:44.044 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 --2- 172.21.15.29:0/2895970203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6410a1f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 -- 172.21.15.29:0/2895970203 >> 172.21.15.29:0/2895970203 conn(0x7f6d641019a0 msgr2=0x7f6d64103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 -- 172.21.15.29:0/2895970203 shutdown_connections 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.816+0000 7f6d6a975640 1 -- 172.21.15.29:0/2895970203 wait complete. 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d6a975640 1 Processor -- start 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d6a975640 1 -- start start 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d6a975640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d6a975640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6410b710 con 0x7f6d64107e00 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d63fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39876/0 (socket says 172.21.15.29:39876) 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.817+0000 7f6d63fff640 1 -- 172.21.15.29:0/3908053625 learned_addr learned my addr 172.21.15.29:0/3908053625 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d63fff640 1 -- 172.21.15.29:0/3908053625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6419bb20 con 0x7f6d64107e00 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d63fff640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6419b5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6d540097f0 tx=0x7f6d54030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:44.045 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d54037040 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f6d54032bb0 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d5403a390 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6419bdb0 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.818+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6419eaa0 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.819+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f6d5403a580 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.819+0000 7f6d617fa640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f6d4c0391b0 0x7f6d4c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.819+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6d5406c650 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.819+0000 7f6d637fe640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f6d4c0391b0 0x7f6d4c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.819+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d64108260 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.820+0000 7f6d637fe640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f6d4c0391b0 0x7f6d4c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d580098c0 tx=0x7f6d58006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:42.824+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d54031560 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.047+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f6d6402d7c0 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.414+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f6d5406c070 con 0x7f6d64107e00 2024-09-19T06:58:44.046 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.416+0000 7f6d617fa640 1 -- 172.21.15.29:0/3908053625 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f6d54049cf0 con 0x7f6d64107e00 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f6d4c0391b0 msgr2=0x7f6d4c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f6d4c0391b0 0x7f6d4c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d580098c0 tx=0x7f6d58006db0 comp rx=0 tx=0).stop 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 msgr2=0x7f6d6419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6419b5e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6d540097f0 tx=0x7f6d54030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 shutdown_connections 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f6d4c0391b0 0x7f6d4c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 --2- 172.21.15.29:0/3908053625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d64107e00 0x7f6d6419b5e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 >> 172.21.15.29:0/3908053625 conn(0x7f6d641019a0 msgr2=0x7f6d64102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 shutdown_connections 2024-09-19T06:58:44.047 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:43.418+0000 7f6d6a975640 1 -- 172.21.15.29:0/3908053625 wait complete. 2024-09-19T06:58:44.296 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:44.149+0000 7fd73711c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:58:44.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3908053625' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T06:58:44.550 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-mon[31255]: mgrmap e5: x(active, since 5s) 2024-09-19T06:58:44.550 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:44.485+0000 7fd73711c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:58:44.551 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:44.549+0000 7fd73711c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:58:44.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:44.753+0000 7fd73711c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:58:45.351 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:58:45.351 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T06:58:45.351 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:58:45.351 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.471+0000 7f9ee3b4c640 1 Processor -- start 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.471+0000 7f9ee3b4c640 1 -- start start 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.472+0000 7f9ee3b4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc10a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.472+0000 7f9ee3b4c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc075760 con 0x7f9edc107e00 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.472+0000 7f9ee18e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc10a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.472+0000 7f9ee18e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc10a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39890/0 (socket says 172.21.15.29:39890) 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.472+0000 7f9ee18e8640 1 -- 172.21.15.29:0/2598152567 learned_addr learned my addr 172.21.15.29:0/2598152567 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.472+0000 7f9ee18e8640 1 -- 172.21.15.29:0/2598152567 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc10a730 con 0x7f9edc107e00 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.473+0000 7f9ee18e8640 1 --2- 172.21.15.29:0/2598152567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc10a1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009820 tx=0x7f9ed802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47eb79ca4966f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:45.352 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.473+0000 7f9ee08e6640 1 -- 172.21.15.29:0/2598152567 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8037070 con 0x7f9edc107e00 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.473+0000 7f9ee08e6640 1 -- 172.21.15.29:0/2598152567 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9ed80328d0 con 0x7f9edc107e00 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.473+0000 7f9ee08e6640 1 -- 172.21.15.29:0/2598152567 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed80307d0 con 0x7f9edc107e00 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.473+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/2598152567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 msgr2=0x7f9edc10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 --2- 172.21.15.29:0/2598152567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc10a1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009820 tx=0x7f9ed802a270 comp rx=0 tx=0).stop 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/2598152567 shutdown_connections 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 --2- 172.21.15.29:0/2598152567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc10a1f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/2598152567 >> 172.21.15.29:0/2598152567 conn(0x7f9edc1019a0 msgr2=0x7f9edc103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/2598152567 shutdown_connections 2024-09-19T06:58:45.353 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/2598152567 wait complete. 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 Processor -- start 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 -- start start 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.474+0000 7f9ee3b4c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10b710 con 0x7f9edc107e00 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee18e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee18e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39900/0 (socket says 172.21.15.29:39900) 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee18e8640 1 -- 172.21.15.29:0/500517650 learned_addr learned my addr 172.21.15.29:0/500517650 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee18e8640 1 -- 172.21.15.29:0/500517650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc19bb20 con 0x7f9edc107e00 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee18e8640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc19b5e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80097f0 tx=0x7f9ed8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed8037040 con 0x7f9edc107e00 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f9ed8032bb0 con 0x7f9edc107e00 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc19bdb0 con 0x7f9edc107e00 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ed803a390 con 0x7f9edc107e00 2024-09-19T06:58:45.354 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.475+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc19eaa0 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.476+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f9ed803b3f0 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.476+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc108260 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.476+0000 7f9ed2ffd640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 0x7f9ec803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.476+0000 7f9ee10e7640 1 -- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 msgr2=0x7f9ec803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/3793715048 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.476+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ed806c930 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.476+0000 7f9ee10e7640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 0x7f9ec803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.481+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ed80371e0 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.677+0000 7f9ee10e7640 1 -- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 msgr2=0x7f9ec803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/3793715048 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.677+0000 7f9ee10e7640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 0x7f9ec803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.710+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9edc02d7c0 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.710+0000 7f9ed2ffd640 1 -- 172.21.15.29:0/500517650 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f9ed8032d60 con 0x7f9edc107e00 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 msgr2=0x7f9ec803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:58:45.355 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 0x7f9ec803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 msgr2=0x7f9edc19b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc19b5e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80097f0 tx=0x7f9ed8030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 shutdown_connections 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f9ec80391b0 0x7f9ec803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 --2- 172.21.15.29:0/500517650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9edc107e00 0x7f9edc19b5e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 >> 172.21.15.29:0/500517650 conn(0x7f9edc1019a0 msgr2=0x7f9edc102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 shutdown_connections 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:44.713+0000 7f9ee3b4c640 1 -- 172.21.15.29:0/500517650 wait complete. 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for the mgr to restart... 2024-09-19T06:58:45.356 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr epoch 5... 2024-09-19T06:58:45.595 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:45 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/500517650' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:58:45.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:45.684+0000 7fd73711c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:58:45.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:45.756+0000 7fd73711c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:58:46.773 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:46.503+0000 7fd73711c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:58:46.773 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:46.623+0000 7fd73711c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:58:47.064 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:46.771+0000 7fd73711c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:58:47.064 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:46.835+0000 7fd73711c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:58:47.064 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:46.992+0000 7fd73711c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:58:47.064 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.063+0000 7fd73711c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:58:47.360 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.125+0000 7fd73711c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:58:47.360 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.292+0000 7fd73711c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:58:47.360 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.359+0000 7fd73711c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:58:47.624 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.428+0000 7fd73711c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:58:47.624 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.515+0000 7fd73711c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:58:47.624 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.577+0000 7fd73711c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:58:48.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:47.638+0000 7fd73711c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:58:48.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:48.464+0000 7fd73711c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:58:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: Active manager daemon x restarted 2024-09-19T06:58:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: Activating manager daemon x 2024-09-19T06:58:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T06:58:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: mgrmap e6: x(active, starting, since 0.00320178s) 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: Manager daemon x is now available 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:58:48.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:48 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:58:50.073 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:58:50.073 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T06:58:50.073 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:58:50.073 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:58:50.073 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.795+0000 7f191329e640 1 Processor -- start 2024-09-19T06:58:50.073 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191329e640 1 -- start start 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191329e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c106060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191329e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f190c075700 con 0x7f190c105c60 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191103a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191103a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c106060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53768/0 (socket says 172.21.15.29:53768) 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191103a640 1 -- 172.21.15.29:0/1919181501 learned_addr learned my addr 172.21.15.29:0/1919181501 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.796+0000 7f191103a640 1 -- 172.21.15.29:0/1919181501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c1065a0 con 0x7f190c105c60 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.797+0000 7f191103a640 1 --2- 172.21.15.29:0/1919181501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c106060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1908009820 tx=0x7f190802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b25177593e7ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.797+0000 7f1903fff640 1 -- 172.21.15.29:0/1919181501 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908037070 con 0x7f190c105c60 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.797+0000 7f1903fff640 1 -- 172.21.15.29:0/1919181501 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f19080328d0 con 0x7f190c105c60 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.797+0000 7f1903fff640 1 -- 172.21.15.29:0/1919181501 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080307d0 con 0x7f190c105c60 2024-09-19T06:58:50.074 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 -- 172.21.15.29:0/1919181501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 msgr2=0x7f190c106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 --2- 172.21.15.29:0/1919181501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c106060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1908009820 tx=0x7f190802a270 comp rx=0 tx=0).stop 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 -- 172.21.15.29:0/1919181501 shutdown_connections 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 --2- 172.21.15.29:0/1919181501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c106060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 -- 172.21.15.29:0/1919181501 >> 172.21.15.29:0/1919181501 conn(0x7f190c1019b0 msgr2=0x7f190c103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 -- 172.21.15.29:0/1919181501 shutdown_connections 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.798+0000 7f191329e640 1 -- 172.21.15.29:0/1919181501 wait complete. 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191329e640 1 Processor -- start 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191329e640 1 -- start start 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191329e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191329e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f190c107640 con 0x7f190c105c60 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191103a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191103a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53772/0 (socket says 172.21.15.29:53772) 2024-09-19T06:58:50.075 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191103a640 1 -- 172.21.15.29:0/4085892247 learned_addr learned my addr 172.21.15.29:0/4085892247 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.799+0000 7f191103a640 1 -- 172.21.15.29:0/4085892247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190c19dd10 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.800+0000 7f191103a640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c19d7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1908032e10 tx=0x7f1908032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.800+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908042070 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.800+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1908030c80 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.800+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190c19dfa0 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.800+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908037040 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.800+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190c1a0c90 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.801+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f1908045070 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.801+0000 7f19027fc640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.801+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 --> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f18f803bd80 con 0x7f18f80391b0 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.801+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f190806c120 con 0x7f190c105c60 2024-09-19T06:58:50.076 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.801+0000 7f1910839640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 msgr2=0x7f18f803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/3793715048 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:45.801+0000 7f1910839640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:46.002+0000 7f1910839640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 msgr2=0x7f18f803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/3793715048 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:46.002+0000 7f1910839640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:46.403+0000 7f1910839640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 msgr2=0x7f18f803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/3793715048 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:46.403+0000 7f1910839640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:47.204+0000 7f1910839640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 msgr2=0x7f18f803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/3793715048 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:47.204+0000 7f1910839640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:48.467+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f190806aca0 con 0x7f190c105c60 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:48.467+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 msgr2=0x7f18f803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:48.467+0000 7f19027fc640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.468+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f19080313a0 con 0x7f190c105c60 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.468+0000 7f19027fc640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f18f803cae0 0x7f18f803eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.468+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1908001d30 con 0x7f18f803cae0 2024-09-19T06:58:50.077 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.469+0000 7f1910839640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f18f803cae0 0x7f18f803eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.469+0000 7f1910839640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f18f803cae0 0x7f18f803eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f18fc003980 tx=0x7f18fc006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.470+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1908001d30 con 0x7f18f803cae0 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.477+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f190c106060 con 0x7f18f803cae0 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.477+0000 7f19027fc640 1 -- 172.21.15.29:0/4085892247 <== mgr.14118 v2:172.21.15.29:6800/1256989766 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f190c106060 con 0x7f18f803cae0 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f18f803cae0 msgr2=0x7f18f803eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f18f803cae0 0x7f18f803eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f18fc003980 tx=0x7f18fc006e10 comp rx=0 tx=0).stop 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 msgr2=0x7f190c19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c19d7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1908032e10 tx=0x7f1908032e40 comp rx=0 tx=0).stop 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 shutdown_connections 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f18f803cae0 0x7f18f803eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:6800/3793715048,v1:172.21.15.29:6801/3793715048] conn(0x7f18f80391b0 0x7f18f803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:50.078 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 --2- 172.21.15.29:0/4085892247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f190c105c60 0x7f190c19d7d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:50.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 >> 172.21.15.29:0/4085892247 conn(0x7f190c1019b0 msgr2=0x7f190c1941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:50.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 shutdown_connections 2024-09-19T06:58:50.079 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:49.478+0000 7f191329e640 1 -- 172.21.15.29:0/4085892247 wait complete. 2024-09-19T06:58:50.079 INFO:teuthology.orchestra.run.smithi029.stdout:mgr epoch 5 is available 2024-09-19T06:58:50.079 INFO:teuthology.orchestra.run.smithi029.stdout:Setting orchestrator backend to cephadm... 2024-09-19T06:58:50.314 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-mon[31255]: Found migration_current of "None". Setting to last migration. 2024-09-19T06:58:50.315 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:50.315 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:50.315 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-mon[31255]: mgrmap e7: x(active, since 1.00524s) 2024-09-19T06:58:51.003 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:50.709+0000 7fd69e476640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:58:50] ENGINE Error in HTTPServer.serve 2024-09-19T06:58:51.003 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: Traceback (most recent call last): 2024-09-19T06:58:51.003 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:58:51.003 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self._connections.run(self.expiration_interval) 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self._run(expiration_interval) 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: s = self.context.wrap_socket( 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: return self.sslsocket_class._create( 2024-09-19T06:58:51.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:58:51.005 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self.do_handshake() 2024-09-19T06:58:51.005 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:58:51.005 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self._sslobj.do_handshake() 2024-09-19T06:58:51.005 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:58:51.005 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:58:51.330 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:51 smithi029 ceph-mon[31255]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:58:51.330 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:51 smithi029 ceph-mon[31255]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:58:51.330 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:51 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:51.330 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:51 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:58:51.337 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fea06007640 1 Processor -- start 2024-09-19T06:58:51.337 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fea06007640 1 -- start start 2024-09-19T06:58:51.337 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fea06007640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea00107790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:51.337 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fea06007640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea00107d60 con 0x7fea00107390 2024-09-19T06:58:51.337 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fe9ff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea00107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:51.337 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fe9ff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea00107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53826/0 (socket says 172.21.15.29:53826) 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.492+0000 7fe9ff7fe640 1 -- 172.21.15.29:0/1379671304 learned_addr learned my addr 172.21.15.29:0/1379671304 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.493+0000 7fe9ff7fe640 1 -- 172.21.15.29:0/1379671304 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea00108590 con 0x7fea00107390 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.493+0000 7fe9ff7fe640 1 --2- 172.21.15.29:0/1379671304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea00107790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009e80 tx=0x7fe9f002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3941a3aba3bb11c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fe9fe7fc640 1 -- 172.21.15.29:0/1379671304 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f0036070 con 0x7fea00107390 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fe9fe7fc640 1 -- 172.21.15.29:0/1379671304 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe9f0031890 con 0x7fea00107390 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fe9fe7fc640 1 -- 172.21.15.29:0/1379671304 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f0007980 con 0x7fea00107390 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 -- 172.21.15.29:0/1379671304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 msgr2=0x7fea00107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 --2- 172.21.15.29:0/1379671304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea00107790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009e80 tx=0x7fe9f002a7a0 comp rx=0 tx=0).stop 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 -- 172.21.15.29:0/1379671304 shutdown_connections 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 --2- 172.21.15.29:0/1379671304 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea00107790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 -- 172.21.15.29:0/1379671304 >> 172.21.15.29:0/1379671304 conn(0x7fea00102ae0 msgr2=0x7fea00104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:51.338 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 -- 172.21.15.29:0/1379671304 shutdown_connections 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.494+0000 7fea06007640 1 -- 172.21.15.29:0/1379671304 wait complete. 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fea06007640 1 Processor -- start 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fea06007640 1 -- start start 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fea06007640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea0019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fea06007640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea0010b940 con 0x7fea00107390 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fe9ff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea0019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fe9ff7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea0019b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53836/0 (socket says 172.21.15.29:53836) 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.495+0000 7fe9ff7fe640 1 -- 172.21.15.29:0/3063506367 learned_addr learned my addr 172.21.15.29:0/3063506367 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fe9ff7fe640 1 -- 172.21.15.29:0/3063506367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0019b800 con 0x7fea00107390 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fe9ff7fe640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea0019b2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9f002acc0 tx=0x7fe9f0031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f0041030 con 0x7fea00107390 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe9f003c900 con 0x7fea00107390 2024-09-19T06:58:51.339 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0019ba90 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9f0036040 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.496+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0019e780 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.497+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fe9f0044070 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.497+0000 7fe9fcff9640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe9e80390f0 0x7fe9e803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.497+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea00107810 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.497+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe9f0042070 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.497+0000 7fe9feffd640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe9e80390f0 0x7fe9e803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.498+0000 7fe9feffd640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe9e80390f0 0x7fe9e803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40098c0 tx=0x7fe9f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.502+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9f004b070 con 0x7fea00107390 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.692+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fea00103d90 con 0x7fe9e80390f0 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.696+0000 7fe9fcff9640 1 -- 172.21.15.29:0/3063506367 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fea00103d90 con 0x7fe9e80390f0 2024-09-19T06:58:51.340 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe9e80390f0 msgr2=0x7fe9e803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe9e80390f0 0x7fe9e803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40098c0 tx=0x7fe9f4006db0 comp rx=0 tx=0).stop 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 msgr2=0x7fea0019b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea0019b2c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe9f002acc0 tx=0x7fe9f0031c70 comp rx=0 tx=0).stop 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 shutdown_connections 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe9e80390f0 0x7fe9e803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 --2- 172.21.15.29:0/3063506367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea00107390 0x7fea0019b2c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 >> 172.21.15.29:0/3063506367 conn(0x7fea00102ae0 msgr2=0x7fea00103680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 shutdown_connections 2024-09-19T06:58:51.341 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:50.699+0000 7fea06007640 1 -- 172.21.15.29:0/3063506367 wait complete. 2024-09-19T06:58:52.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: [19/Sep/2024:06:58:50] ENGINE Bus STARTING 2024-09-19T06:58:52.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: [19/Sep/2024:06:58:50] ENGINE Serving on http://172.21.15.29:8765 2024-09-19T06:58:52.300 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: [19/Sep/2024:06:58:50] ENGINE Serving on https://172.21.15.29:7150 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: [19/Sep/2024:06:58:50] ENGINE Bus STARTED 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: [19/Sep/2024:06:58:50] ENGINE Error in HTTPServer.serve 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: Traceback (most recent call last): 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._run(expiration_interval) 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:58:52.301 INFO:journalctl@ceph.mon.a.smithi029.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: s = self.context.wrap_socket( 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: return self.sslsocket_class._create( 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: self.do_handshake() 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._sslobj.do_handshake() 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:58:52.302 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:52 smithi029 ceph-mon[31255]: mgrmap e8: x(active, since 2s) 2024-09-19T06:58:52.602 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe30dddf640 1 Processor -- start 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe30dddf640 1 -- start start 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe30dddf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe308107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe30dddf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe308107df0 con 0x7fe308107420 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe3077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe308107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe3077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe308107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53838/0 (socket says 172.21.15.29:53838) 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.754+0000 7fe3077fe640 1 -- 172.21.15.29:0/1350391219 learned_addr learned my addr 172.21.15.29:0/1350391219 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.755+0000 7fe3077fe640 1 -- 172.21.15.29:0/1350391219 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe308108580 con 0x7fe308107420 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.755+0000 7fe3077fe640 1 --2- 172.21.15.29:0/1350391219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe308107820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009820 tx=0x7fe2f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4921da7bf697ed75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe306ffd640 1 -- 172.21.15.29:0/1350391219 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f8037070 con 0x7fe308107420 2024-09-19T06:58:52.603 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe306ffd640 1 -- 172.21.15.29:0/1350391219 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe2f80328d0 con 0x7fe308107420 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe306ffd640 1 -- 172.21.15.29:0/1350391219 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f80307d0 con 0x7fe308107420 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 -- 172.21.15.29:0/1350391219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 msgr2=0x7fe308107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 --2- 172.21.15.29:0/1350391219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe308107820 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009820 tx=0x7fe2f802a270 comp rx=0 tx=0).stop 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 -- 172.21.15.29:0/1350391219 shutdown_connections 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 --2- 172.21.15.29:0/1350391219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe308107820 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 -- 172.21.15.29:0/1350391219 >> 172.21.15.29:0/1350391219 conn(0x7fe308102b70 msgr2=0x7fe308104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 -- 172.21.15.29:0/1350391219 shutdown_connections 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.756+0000 7fe30dddf640 1 -- 172.21.15.29:0/1350391219 wait complete. 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.757+0000 7fe30dddf640 1 Processor -- start 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.757+0000 7fe30dddf640 1 -- start start 2024-09-19T06:58:52.604 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.757+0000 7fe30dddf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe30819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.757+0000 7fe30dddf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe30810b930 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe30819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3077fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe30819b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53840/0 (socket says 172.21.15.29:53840) 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3077fe640 1 -- 172.21.15.29:0/388207156 learned_addr learned my addr 172.21.15.29:0/388207156 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3077fe640 1 -- 172.21.15.29:0/388207156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30819bb30 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3077fe640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe30819b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009940 tx=0x7fe2f8032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f8042070 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe2f8030c80 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f8037040 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30819bdc0 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.758+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30819eab0 con 0x7fe308107420 2024-09-19T06:58:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.759+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe2f8045070 con 0x7fe308107420 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.759+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30810bab0 con 0x7fe308107420 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.759+0000 7fe3057fa640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe2f4039200 0x7fe2f403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.759+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe2f806c150 con 0x7fe308107420 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.760+0000 7fe2feffd640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe2f4039200 0x7fe2f403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.760+0000 7fe2feffd640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe2f4039200 0x7fe2f403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00098c0 tx=0x7fe2f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.764+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2f8045360 con 0x7fe308107420 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.941+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fe308103ee0 con 0x7fe2f4039200 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.941+0000 7fe3057fa640 1 -- 172.21.15.29:0/388207156 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fe308103ee0 con 0x7fe2f4039200 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.943+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe2f4039200 msgr2=0x7fe2f403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.943+0000 7fe30dddf640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe2f4039200 0x7fe2f403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00098c0 tx=0x7fe2f0006db0 comp rx=0 tx=0).stop 2024-09-19T06:58:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.943+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 msgr2=0x7fe30819b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.943+0000 7fe30dddf640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe30819b5f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009940 tx=0x7fe2f8032e10 comp rx=0 tx=0).stop 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.944+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 shutdown_connections 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.944+0000 7fe30dddf640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fe2f4039200 0x7fe2f403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.944+0000 7fe30dddf640 1 --2- 172.21.15.29:0/388207156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe308107420 0x7fe30819b5f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.944+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 >> 172.21.15.29:0/388207156 conn(0x7fe308102b70 msgr2=0x7fe308103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.944+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 shutdown_connections 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:51.944+0000 7fe30dddf640 1 -- 172.21.15.29:0/388207156 wait complete. 2024-09-19T06:58:52.607 INFO:teuthology.orchestra.run.smithi029.stdout:Generating ssh key... 2024-09-19T06:58:53.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-mon[31255]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:53.875 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: Generating public/private rsa key pair. 2024-09-19T06:58:53.875 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: Your identification has been saved in /tmp/tmpgw3tcees/key 2024-09-19T06:58:53.875 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: Your public key has been saved in /tmp/tmpgw3tcees/key.pub 2024-09-19T06:58:53.875 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: The key fingerprint is: 2024-09-19T06:58:53.875 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: SHA256:6Y0P+R0HAmMgmksR4IUqc/kBOzGi7e0p6ieKk0QZ8f4 ceph-6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:53.876 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: The key's randomart image is: 2024-09-19T06:58:53.876 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: +---[RSA 3072]----+ 2024-09-19T06:58:53.876 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |.o=o. . | 2024-09-19T06:58:53.876 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |oo*+ . . | 2024-09-19T06:58:53.876 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |o+*B + | 2024-09-19T06:58:53.876 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |=+B.. . + | 2024-09-19T06:58:53.877 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |o+.= . S . . | 2024-09-19T06:58:53.877 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: | .. + . + . . | 2024-09-19T06:58:53.877 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |.. . E = . . . | 2024-09-19T06:58:53.877 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |+...o + . o | 2024-09-19T06:58:53.877 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: |*+o. o . | 2024-09-19T06:58:53.877 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:58:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: +----[SHA256]-----+ 2024-09-19T06:58:54.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:54 smithi029 ceph-mon[31255]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:54.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:54 smithi029 ceph-mon[31255]: Generating ssh key... 2024-09-19T06:58:54.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:54 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:54.175 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:54 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:58:54.183 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.018+0000 7f3fbe878640 1 Processor -- start 2024-09-19T06:58:54.183 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.018+0000 7f3fbe878640 1 -- start start 2024-09-19T06:58:54.183 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.018+0000 7f3fbe878640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb807c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:54.183 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.018+0000 7f3fbe878640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb807c850 con 0x7f3fb807de20 2024-09-19T06:58:54.183 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.019+0000 7f3fb7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb807c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.019+0000 7f3fb7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb807c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53852/0 (socket says 172.21.15.29:53852) 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.019+0000 7f3fb7fff640 1 -- 172.21.15.29:0/3569857149 learned_addr learned my addr 172.21.15.29:0/3569857149 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.019+0000 7f3fb7fff640 1 -- 172.21.15.29:0/3569857149 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb807c9d0 con 0x7f3fb807de20 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fb7fff640 1 --2- 172.21.15.29:0/3569857149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb807c280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009820 tx=0x7f3fa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3652e8de2121a531 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fb6ffd640 1 -- 172.21.15.29:0/3569857149 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fa8037070 con 0x7f3fb807de20 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fb6ffd640 1 -- 172.21.15.29:0/3569857149 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3fa80328d0 con 0x7f3fb807de20 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fb6ffd640 1 -- 172.21.15.29:0/3569857149 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fa80307d0 con 0x7f3fb807de20 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fbe878640 1 -- 172.21.15.29:0/3569857149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 msgr2=0x7f3fb807c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fbe878640 1 --2- 172.21.15.29:0/3569857149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb807c280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009820 tx=0x7f3fa802a270 comp rx=0 tx=0).stop 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fbe878640 1 -- 172.21.15.29:0/3569857149 shutdown_connections 2024-09-19T06:58:54.184 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fbe878640 1 --2- 172.21.15.29:0/3569857149 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb807c280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.020+0000 7f3fbe878640 1 -- 172.21.15.29:0/3569857149 >> 172.21.15.29:0/3569857149 conn(0x7f3fb8102b10 msgr2=0x7f3fb8104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.021+0000 7f3fbe878640 1 -- 172.21.15.29:0/3569857149 shutdown_connections 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.021+0000 7f3fbe878640 1 -- 172.21.15.29:0/3569857149 wait complete. 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.021+0000 7f3fbe878640 1 Processor -- start 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.021+0000 7f3fbe878640 1 -- start start 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fbe878640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fbe878640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb810d950 con 0x7f3fb807de20 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb819d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53856/0 (socket says 172.21.15.29:53856) 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb7fff640 1 -- 172.21.15.29:0/2562214011 learned_addr learned my addr 172.21.15.29:0/2562214011 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb7fff640 1 -- 172.21.15.29:0/2562214011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb819dcd0 con 0x7f3fb807de20 2024-09-19T06:58:54.185 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb7fff640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb819d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80097f0 tx=0x7f3fa8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fa8037040 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3fa8032bb0 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb819df60 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fa803a390 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.022+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb81a0c50 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.023+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3fa803a580 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.024+0000 7f3fb57fa640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3fa0039200 0x7f3fa003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.024+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3fa806c4c0 con 0x7f3fb807de20 2024-09-19T06:58:54.186 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.024+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fb807c300 con 0x7f3fb807de20 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.024+0000 7f3fb77fe640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3fa0039200 0x7f3fa003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.024+0000 7f3fb77fe640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3fa0039200 0x7f3fa003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0098c0 tx=0x7f3fac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.029+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3fa8040210 con 0x7f3fb807de20 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.209+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f3fb8103e90 con 0x7f3fa0039200 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.617+0000 7f3fb57fa640 1 -- 172.21.15.29:0/2562214011 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3fb8103e90 con 0x7f3fa0039200 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3fa0039200 msgr2=0x7f3fa003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.187 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3fa0039200 0x7f3fa003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0098c0 tx=0x7f3fac006db0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 msgr2=0x7f3fb819d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb819d790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3fa80097f0 tx=0x7f3fa8030d00 comp rx=0 tx=0).stop 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 shutdown_connections 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3fa0039200 0x7f3fa003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 --2- 172.21.15.29:0/2562214011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fb807de20 0x7f3fb819d790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 >> 172.21.15.29:0/2562214011 conn(0x7f3fb8102b10 msgr2=0x7f3fb8103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 shutdown_connections 2024-09-19T06:58:54.188 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:53.619+0000 7f3fbe878640 1 -- 172.21.15.29:0/2562214011 wait complete. 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.569+0000 7fcb343da640 1 Processor -- start 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.569+0000 7fcb343da640 1 -- start start 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.570+0000 7fcb343da640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.570+0000 7fcb343da640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c107d50 con 0x7fcb2c107380 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.570+0000 7fcb32176640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.570+0000 7fcb32176640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53864/0 (socket says 172.21.15.29:53864) 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.570+0000 7fcb32176640 1 -- 172.21.15.29:0/1584495091 learned_addr learned my addr 172.21.15.29:0/1584495091 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.570+0000 7fcb32176640 1 -- 172.21.15.29:0/1584495091 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c108580 con 0x7fcb2c107380 2024-09-19T06:58:55.373 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.571+0000 7fcb32176640 1 --2- 172.21.15.29:0/1584495091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c107780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009e80 tx=0x7fcb2402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431567f0586126c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.571+0000 7fcb31174640 1 -- 172.21.15.29:0/1584495091 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb24036070 con 0x7fcb2c107380 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.571+0000 7fcb31174640 1 -- 172.21.15.29:0/1584495091 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcb24031890 con 0x7fcb2c107380 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.571+0000 7fcb31174640 1 -- 172.21.15.29:0/1584495091 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb24007980 con 0x7fcb2c107380 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 -- 172.21.15.29:0/1584495091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 msgr2=0x7fcb2c107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 --2- 172.21.15.29:0/1584495091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c107780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009e80 tx=0x7fcb2402a7a0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 -- 172.21.15.29:0/1584495091 shutdown_connections 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 --2- 172.21.15.29:0/1584495091 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c107780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 -- 172.21.15.29:0/1584495091 >> 172.21.15.29:0/1584495091 conn(0x7fcb2c102b10 msgr2=0x7fcb2c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 -- 172.21.15.29:0/1584495091 shutdown_connections 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 -- 172.21.15.29:0/1584495091 wait complete. 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.572+0000 7fcb343da640 1 Processor -- start 2024-09-19T06:58:55.374 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb343da640 1 -- start start 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb343da640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb343da640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c10b930 con 0x7fcb2c107380 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb32176640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb32176640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c19b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53866/0 (socket says 172.21.15.29:53866) 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb32176640 1 -- 172.21.15.29:0/3043894134 learned_addr learned my addr 172.21.15.29:0/3043894134 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb32176640 1 -- 172.21.15.29:0/3043894134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c19baf0 con 0x7fcb2c107380 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb32176640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c19b5b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb24007bb0 tx=0x7fcb24031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb24041020 con 0x7fcb2c107380 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c19bd80 con 0x7fcb2c107380 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fcb2403c900 con 0x7fcb2c107380 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.573+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb24036040 con 0x7fcb2c107380 2024-09-19T06:58:55.375 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.574+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c19ea70 con 0x7fcb2c107380 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.574+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fcb24044020 con 0x7fcb2c107380 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.574+0000 7fcb2b7fe640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fcb140391b0 0x7fcb1403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.575+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcb2406d700 con 0x7fcb2c107380 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.575+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c10bab0 con 0x7fcb2c107380 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.575+0000 7fcb31975640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fcb140391b0 0x7fcb1403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.575+0000 7fcb31975640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fcb140391b0 0x7fcb1403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb200098c0 tx=0x7fcb20006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.579+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb2404b020 con 0x7fcb2c107380 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.756+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fcb2c103dd0 con 0x7fcb140391b0 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.757+0000 7fcb2b7fe640 1 -- 172.21.15.29:0/3043894134 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fcb2c103dd0 con 0x7fcb140391b0 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fcb140391b0 msgr2=0x7fcb1403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.376 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fcb140391b0 0x7fcb1403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb200098c0 tx=0x7fcb20006db0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 msgr2=0x7fcb2c19b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c19b5b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcb24007bb0 tx=0x7fcb24031c70 comp rx=0 tx=0).stop 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 shutdown_connections 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7fcb140391b0 0x7fcb1403b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 --2- 172.21.15.29:0/3043894134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb2c107380 0x7fcb2c19b5b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 >> 172.21.15.29:0/3043894134 conn(0x7fcb2c102b10 msgr2=0x7fcb2c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 shutdown_connections 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:54.759+0000 7fcb343da640 1 -- 172.21.15.29:0/3043894134 wait complete. 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:58:55.377 INFO:teuthology.orchestra.run.smithi029.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T06:58:55.383 INFO:teuthology.orchestra.run.smithi029.stdout:Adding host smithi029... 2024-09-19T06:58:55.620 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:55 smithi029 ceph-mon[31255]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:56.771 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:56 smithi029 ceph-mon[31255]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi029", "addr": "172.21.15.29", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:57.688 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:58:57 smithi029 ceph-mon[31255]: Deploying cephadm binary to smithi029 2024-09-19T06:59:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Added host 'smithi029' with addr '172.21.15.29' 2024-09-19T06:59:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.815+0000 7f8fcb4c7640 1 Processor -- start 2024-09-19T06:59:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.815+0000 7f8fcb4c7640 1 -- start start 2024-09-19T06:59:00.584 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.815+0000 7f8fcb4c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc4107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.815+0000 7f8fcb4c7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc4107d50 con 0x7f8fc4107380 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.816+0000 7f8fc9263640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc4107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.816+0000 7f8fc9263640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc4107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36456/0 (socket says 172.21.15.29:36456) 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.816+0000 7f8fc9263640 1 -- 172.21.15.29:0/15174424 learned_addr learned my addr 172.21.15.29:0/15174424 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.816+0000 7f8fc9263640 1 -- 172.21.15.29:0/15174424 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc4108580 con 0x7f8fc4107380 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.816+0000 7f8fc9263640 1 --2- 172.21.15.29:0/15174424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc4107780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009820 tx=0x7f8fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac02c747a4c9eecc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fbbfff640 1 -- 172.21.15.29:0/15174424 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc0037070 con 0x7f8fc4107380 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fbbfff640 1 -- 172.21.15.29:0/15174424 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8fc00328d0 con 0x7f8fc4107380 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fbbfff640 1 -- 172.21.15.29:0/15174424 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc00307d0 con 0x7f8fc4107380 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/15174424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 msgr2=0x7f8fc4107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fcb4c7640 1 --2- 172.21.15.29:0/15174424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc4107780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009820 tx=0x7f8fc002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:00.585 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/15174424 shutdown_connections 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fcb4c7640 1 --2- 172.21.15.29:0/15174424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc4107780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/15174424 >> 172.21.15.29:0/15174424 conn(0x7f8fc4102b10 msgr2=0x7f8fc4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.817+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/15174424 shutdown_connections 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/15174424 wait complete. 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fcb4c7640 1 Processor -- start 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fcb4c7640 1 -- start start 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fcb4c7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fcb4c7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc410b930 con 0x7f8fc4107380 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fc9263640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fc9263640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36472/0 (socket says 172.21.15.29:36472) 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.818+0000 7f8fc9263640 1 -- 172.21.15.29:0/3822604064 learned_addr learned my addr 172.21.15.29:0/3822604064 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:00.586 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fc9263640 1 -- 172.21.15.29:0/3822604064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc419baf0 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fc9263640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc419b5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00097f0 tx=0x7f8fc0030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc0037040 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8fc0032bb0 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc419bd80 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fc003a390 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.819+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc419ea70 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.820+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f8fc003b3f0 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.820+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc410bab0 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.820+0000 7f8fba7fc640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f8fb0039200 0x7f8fb003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.820+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8fc006c430 con 0x7f8fc4107380 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.820+0000 7f8fc8a62640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f8fb0039200 0x7f8fb003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.821+0000 7f8fc8a62640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f8fb0039200 0x7f8fb003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40098c0 tx=0x7f8fb4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:00.587 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:55.825+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8fc0007050 con 0x7f8fc4107380 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:56.008+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi029", "addr": "172.21.15.29", "target": ["mon-mgr", ""]}) -- 0x7f8fc4103dd0 con 0x7f8fb0039200 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.959+0000 7f8fba7fc640 1 -- 172.21.15.29:0/3822604064 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8fc4103dd0 con 0x7f8fb0039200 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f8fb0039200 msgr2=0x7f8fb003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f8fb0039200 0x7f8fb003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40098c0 tx=0x7f8fb4006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 msgr2=0x7f8fc419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc419b5b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00097f0 tx=0x7f8fc0030d00 comp rx=0 tx=0).stop 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 shutdown_connections 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f8fb0039200 0x7f8fb003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 --2- 172.21.15.29:0/3822604064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8fc4107380 0x7f8fc419b5b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 >> 172.21.15.29:0/3822604064 conn(0x7f8fc4102b10 msgr2=0x7f8fc4103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 shutdown_connections 2024-09-19T06:59:00.588 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:58:59.963+0000 7f8fcb4c7640 1 -- 172.21.15.29:0/3822604064 wait complete. 2024-09-19T06:59:00.589 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying unmanaged mon service... 2024-09-19T06:59:01.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:00 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:01.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:00 smithi029 ceph-mon[31255]: Added host smithi029 2024-09-19T06:59:01.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:00 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:59:01.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T06:59:01.818 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d85c54640 1 Processor -- start 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d85c54640 1 -- start start 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d85c54640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d80106060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d85c54640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8007bdd0 con 0x7f4d80105c60 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d80106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d80106060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36486/0 (socket says 172.21.15.29:36486) 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.007+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/859499670 learned_addr learned my addr 172.21.15.29:0/859499670 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.008+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/859499670 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d801065a0 con 0x7f4d80105c60 2024-09-19T06:59:01.819 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.008+0000 7f4d7f7fe640 1 --2- 172.21.15.29:0/859499670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d80106060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009820 tx=0x7f4d7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a02298da00b45a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:01.822 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d7effd640 1 -- 172.21.15.29:0/859499670 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d70037070 con 0x7f4d80105c60 2024-09-19T06:59:01.822 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d7effd640 1 -- 172.21.15.29:0/859499670 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4d700328d0 con 0x7f4d80105c60 2024-09-19T06:59:01.822 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d7effd640 1 -- 172.21.15.29:0/859499670 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d700307d0 con 0x7f4d80105c60 2024-09-19T06:59:01.822 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 -- 172.21.15.29:0/859499670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 msgr2=0x7f4d80106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 --2- 172.21.15.29:0/859499670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d80106060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009820 tx=0x7f4d7002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 -- 172.21.15.29:0/859499670 shutdown_connections 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 --2- 172.21.15.29:0/859499670 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d80106060 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 -- 172.21.15.29:0/859499670 >> 172.21.15.29:0/859499670 conn(0x7f4d801019d0 msgr2=0x7f4d80103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 -- 172.21.15.29:0/859499670 shutdown_connections 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.009+0000 7f4d85c54640 1 -- 172.21.15.29:0/859499670 wait complete. 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d85c54640 1 Processor -- start 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d85c54640 1 -- start start 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d85c54640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d8019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d85c54640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4d80107640 con 0x7f4d80105c60 2024-09-19T06:59:01.828 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d8019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d7f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d8019d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36494/0 (socket says 172.21.15.29:36494) 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.010+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/1691438612 learned_addr learned my addr 172.21.15.29:0/1691438612 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d7f7fe640 1 -- 172.21.15.29:0/1691438612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8019dd50 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d7f7fe640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d8019d810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097f0 tx=0x7f4d70030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d70037040 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f4d7003b3f0 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8019dfe0 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d7003a520 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.011+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d801a0cd0 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.012+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4d70032820 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.012+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d80106060 con 0x7f4d80105c60 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.012+0000 7f4d7d7fa640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f4d6c039200 0x7f4d6c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.012+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4d7006c430 con 0x7f4d80105c60 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.012+0000 7f4d76ffd640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f4d6c039200 0x7f4d6c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.013+0000 7f4d76ffd640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f4d6c039200 0x7f4d6c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d680098c0 tx=0x7f4d68006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.017+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d7003b9e0 con 0x7f4d80105c60 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.212+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4d80062630 con 0x7f4d6c039200 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.217+0000 7f4d7d7fa640 1 -- 172.21.15.29:0/1691438612 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4d80062630 con 0x7f4d6c039200 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f4d6c039200 msgr2=0x7f4d6c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f4d6c039200 0x7f4d6c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d680098c0 tx=0x7f4d68006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 msgr2=0x7f4d8019d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d8019d810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097f0 tx=0x7f4d70030d00 comp rx=0 tx=0).stop 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 shutdown_connections 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f4d6c039200 0x7f4d6c03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 --2- 172.21.15.29:0/1691438612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d80105c60 0x7f4d8019d810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:01.830 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 >> 172.21.15.29:0/1691438612 conn(0x7f4d801019d0 msgr2=0x7f4d801941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:01.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 shutdown_connections 2024-09-19T06:59:01.831 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:01.219+0000 7f4d85c54640 1 -- 172.21.15.29:0/1691438612 wait complete. 2024-09-19T06:59:01.831 INFO:teuthology.orchestra.run.smithi029.stdout:Deploying unmanaged mgr service... 2024-09-19T06:59:02.327 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:02 smithi029 ceph-mon[31255]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:02.327 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:02 smithi029 ceph-mon[31255]: Saving service mon spec with placement count:5 2024-09-19T06:59:02.327 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:02 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:03.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:03 smithi029 ceph-mon[31255]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:03.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:03 smithi029 ceph-mon[31255]: Saving service mgr spec with placement count:2 2024-09-19T06:59:03.752 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:03 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e4661b640 1 Processor -- start 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e4661b640 1 -- start start 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e4661b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e40106060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e4661b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4007bdd0 con 0x7f1e40105c60 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e3ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e40106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e3ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e40106060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36508/0 (socket says 172.21.15.29:36508) 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e3ffff640 1 -- 172.21.15.29:0/2532617969 learned_addr learned my addr 172.21.15.29:0/2532617969 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:04.247 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.325+0000 7f1e3ffff640 1 -- 172.21.15.29:0/2532617969 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e401065a0 con 0x7f1e40105c60 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.326+0000 7f1e3ffff640 1 --2- 172.21.15.29:0/2532617969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e40106060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009820 tx=0x7f1e3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3887f5c5ea43da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e3effd640 1 -- 172.21.15.29:0/2532617969 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e30037070 con 0x7f1e40105c60 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e3effd640 1 -- 172.21.15.29:0/2532617969 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1e300328d0 con 0x7f1e40105c60 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e3effd640 1 -- 172.21.15.29:0/2532617969 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e300307d0 con 0x7f1e40105c60 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 -- 172.21.15.29:0/2532617969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 msgr2=0x7f1e40106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 --2- 172.21.15.29:0/2532617969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e40106060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009820 tx=0x7f1e3002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 -- 172.21.15.29:0/2532617969 shutdown_connections 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 --2- 172.21.15.29:0/2532617969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e40106060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 -- 172.21.15.29:0/2532617969 >> 172.21.15.29:0/2532617969 conn(0x7f1e401019d0 msgr2=0x7f1e40103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 -- 172.21.15.29:0/2532617969 shutdown_connections 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.327+0000 7f1e4661b640 1 -- 172.21.15.29:0/2532617969 wait complete. 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.328+0000 7f1e4661b640 1 Processor -- start 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.328+0000 7f1e4661b640 1 -- start start 2024-09-19T06:59:04.248 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.328+0000 7f1e4661b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e4019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.328+0000 7f1e4661b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40107640 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e4019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e4019d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36514/0 (socket says 172.21.15.29:36514) 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3ffff640 1 -- 172.21.15.29:0/2521013563 learned_addr learned my addr 172.21.15.29:0/2521013563 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3ffff640 1 -- 172.21.15.29:0/2521013563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4019dd50 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3ffff640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e4019d810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e300097f0 tx=0x7f1e30030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e30037040 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1e3003b3f0 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4019dfe0 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e3003a520 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.329+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e401a0cd0 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.330+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1e3003a6c0 con 0x7f1e40105c60 2024-09-19T06:59:04.249 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.331+0000 7f1e3d7fa640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f1e28039200 0x7f1e2803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.330+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e40106060 con 0x7f1e40105c60 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.331+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1e3006c550 con 0x7f1e40105c60 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.331+0000 7f1e3f7fe640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f1e28039200 0x7f1e2803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.331+0000 7f1e3f7fe640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f1e28039200 0x7f1e2803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e340098c0 tx=0x7f1e34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.336+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e30040210 con 0x7f1e40105c60 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.539+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1e40062630 con 0x7f1e28039200 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.543+0000 7f1e3d7fa640 1 -- 172.21.15.29:0/2521013563 <== mgr.14118 v2:172.21.15.29:6800/1256989766 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1e40062630 con 0x7f1e28039200 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f1e28039200 msgr2=0x7f1e2803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f1e28039200 0x7f1e2803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e340098c0 tx=0x7f1e34006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 msgr2=0x7f1e4019d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e4019d810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1e300097f0 tx=0x7f1e30030d00 comp rx=0 tx=0).stop 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 shutdown_connections 2024-09-19T06:59:04.250 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f1e28039200 0x7f1e2803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:04.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 --2- 172.21.15.29:0/2521013563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e40105c60 0x7f1e4019d810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:04.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 >> 172.21.15.29:0/2521013563 conn(0x7f1e401019d0 msgr2=0x7f1e401941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:04.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 shutdown_connections 2024-09-19T06:59:04.251 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:02.546+0000 7f1e4661b640 1 -- 172.21.15.29:0/2521013563 wait complete. 2024-09-19T06:59:05.042 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:04 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:05.042 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:04 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:05 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/841103192' entity='client.admin' 2024-09-19T06:59:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:05 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6047768640 1 Processor -- start 2024-09-19T06:59:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6047768640 1 -- start start 2024-09-19T06:59:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6047768640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604007c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6047768640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f604007c870 con 0x7f604007de40 2024-09-19T06:59:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6045504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604007c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:06.196 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6045504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604007c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36526/0 (socket says 172.21.15.29:36526) 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6045504640 1 -- 172.21.15.29:0/1228510791 learned_addr learned my addr 172.21.15.29:0/1228510791 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.661+0000 7f6045504640 1 -- 172.21.15.29:0/1228510791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604007c9f0 con 0x7f604007de40 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.662+0000 7f6045504640 1 --2- 172.21.15.29:0/1228510791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604007c2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f603c009820 tx=0x7f603c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2945bb889d4b133 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.662+0000 7f6037fff640 1 -- 172.21.15.29:0/1228510791 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603c037070 con 0x7f604007de40 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.662+0000 7f6037fff640 1 -- 172.21.15.29:0/1228510791 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f603c0328f0 con 0x7f604007de40 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.662+0000 7f6037fff640 1 -- 172.21.15.29:0/1228510791 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603c030740 con 0x7f604007de40 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 -- 172.21.15.29:0/1228510791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 msgr2=0x7f604007c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:06.197 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 --2- 172.21.15.29:0/1228510791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604007c2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f603c009820 tx=0x7f603c02a270 comp rx=0 tx=0).stop 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 -- 172.21.15.29:0/1228510791 shutdown_connections 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 --2- 172.21.15.29:0/1228510791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604007c2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 -- 172.21.15.29:0/1228510791 >> 172.21.15.29:0/1228510791 conn(0x7f6040102b10 msgr2=0x7f6040104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 -- 172.21.15.29:0/1228510791 shutdown_connections 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.663+0000 7f6047768640 1 -- 172.21.15.29:0/1228510791 wait complete. 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6047768640 1 Processor -- start 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6047768640 1 -- start start 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6047768640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6047768640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f604010d9f0 con 0x7f604007de40 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6045504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6045504640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:36542/0 (socket says 172.21.15.29:36542) 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6045504640 1 -- 172.21.15.29:0/841103192 learned_addr learned my addr 172.21.15.29:0/841103192 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:06.198 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6045504640 1 -- 172.21.15.29:0/841103192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604019dcf0 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6045504640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604019d7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f603c030cc0 tx=0x7f603c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603c042070 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f603c030e60 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604019df80 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.664+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f603c037040 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.665+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60401a0c70 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.666+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f603c045070 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.666+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604007c320 con 0x7f604007de40 2024-09-19T06:59:06.199 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.666+0000 7f60367fc640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f602c039200 0x7f602c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.666+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f603c06c2f0 con 0x7f604007de40 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.666+0000 7f6044d03640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f602c039200 0x7f602c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.666+0000 7f6044d03640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f602c039200 0x7f602c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60300098c0 tx=0x7f6030006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.671+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f603c04b170 con 0x7f604007de40 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.866+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f60401a0f50 con 0x7f604007de40 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.868+0000 7f60367fc640 1 -- 172.21.15.29:0/841103192 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f603c02fd90 con 0x7f604007de40 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f602c039200 msgr2=0x7f602c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f602c039200 0x7f602c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60300098c0 tx=0x7f6030006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 msgr2=0x7f604019d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604019d7b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f603c030cc0 tx=0x7f603c030cf0 comp rx=0 tx=0).stop 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 shutdown_connections 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f602c039200 0x7f602c03b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:06.200 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 --2- 172.21.15.29:0/841103192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604007de40 0x7f604019d7b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:06.201 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 >> 172.21.15.29:0/841103192 conn(0x7f6040102b10 msgr2=0x7f6040103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:06.201 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 shutdown_connections 2024-09-19T06:59:06.201 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:04.871+0000 7f6047768640 1 -- 172.21.15.29:0/841103192 wait complete. 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.698+0000 7f650b860640 1 Processor -- start 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.698+0000 7f650b860640 1 -- start start 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.698+0000 7f650b860640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650407b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.698+0000 7f650b860640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f650407b690 con 0x7f650407ccf0 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.699+0000 7f65095fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650407b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.699+0000 7f65095fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650407b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34634/0 (socket says 172.21.15.29:34634) 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.699+0000 7f65095fc640 1 -- 172.21.15.29:0/2250616625 learned_addr learned my addr 172.21.15.29:0/2250616625 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.699+0000 7f65095fc640 1 -- 172.21.15.29:0/2250616625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650407b810 con 0x7f650407ccf0 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.699+0000 7f65095fc640 1 --2- 172.21.15.29:0/2250616625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650407b150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6500009820 tx=0x7f650002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0fa34669139872 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f64fbfff640 1 -- 172.21.15.29:0/2250616625 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500037070 con 0x7f650407ccf0 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f64fbfff640 1 -- 172.21.15.29:0/2250616625 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65000328f0 con 0x7f650407ccf0 2024-09-19T06:59:07.627 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f64fbfff640 1 -- 172.21.15.29:0/2250616625 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500030740 con 0x7f650407ccf0 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f650b860640 1 -- 172.21.15.29:0/2250616625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 msgr2=0x7f650407b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f650b860640 1 --2- 172.21.15.29:0/2250616625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650407b150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6500009820 tx=0x7f650002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f650b860640 1 -- 172.21.15.29:0/2250616625 shutdown_connections 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f650b860640 1 --2- 172.21.15.29:0/2250616625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650407b150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.700+0000 7f650b860640 1 -- 172.21.15.29:0/2250616625 >> 172.21.15.29:0/2250616625 conn(0x7f6504102ae0 msgr2=0x7f6504104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.701+0000 7f650b860640 1 -- 172.21.15.29:0/2250616625 shutdown_connections 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.701+0000 7f650b860640 1 -- 172.21.15.29:0/2250616625 wait complete. 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.701+0000 7f650b860640 1 Processor -- start 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.701+0000 7f650b860640 1 -- start start 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.701+0000 7f650b860640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.701+0000 7f650b860640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f650410d980 con 0x7f650407ccf0 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f65095fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:07.628 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f65095fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34646/0 (socket says 172.21.15.29:34646) 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f65095fc640 1 -- 172.21.15.29:0/1629864355 learned_addr learned my addr 172.21.15.29:0/1629864355 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f65095fc640 1 -- 172.21.15.29:0/1629864355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650419dd50 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f65095fc640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650419d810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6500030cc0 tx=0x7f6500030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500042070 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6500030e60 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f650419dfe0 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6500037040 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.702+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65041a0cd0 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.703+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6500045070 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.703+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f650407b1d0 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.703+0000 7f64fa7fc640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f64f0039200 0x7f64f003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.703+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f650006c2d0 con 0x7f650407ccf0 2024-09-19T06:59:07.629 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.704+0000 7f6508dfb640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f64f0039200 0x7f64f003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.704+0000 7f6508dfb640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f64f0039200 0x7f64f003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f64f40098c0 tx=0x7f64f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.708+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f650004b170 con 0x7f650407ccf0 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.890+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f650402d7c0 con 0x7f650407ccf0 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.893+0000 7f64fa7fc640 1 -- 172.21.15.29:0/1629864355 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f650002fd90 con 0x7f650407ccf0 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.895+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f64f0039200 msgr2=0x7f64f003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.895+0000 7f650b860640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f64f0039200 0x7f64f003b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f64f40098c0 tx=0x7f64f4006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.895+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 msgr2=0x7f650419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.895+0000 7f650b860640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650419d810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6500030cc0 tx=0x7f6500030cf0 comp rx=0 tx=0).stop 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.895+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 shutdown_connections 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.896+0000 7f650b860640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f64f0039200 0x7f64f003b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.896+0000 7f650b860640 1 --2- 172.21.15.29:0/1629864355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f650407ccf0 0x7f650419d810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.896+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 >> 172.21.15.29:0/1629864355 conn(0x7f6504102ae0 msgr2=0x7f6504103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:07.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.896+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 shutdown_connections 2024-09-19T06:59:07.631 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:06.896+0000 7f650b860640 1 -- 172.21.15.29:0/1629864355 wait complete. 2024-09-19T06:59:07.631 INFO:teuthology.orchestra.run.smithi029.stdout:Enabling the dashboard module... 2024-09-19T06:59:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:07 smithi029 ceph-mon[31255]: from='mgr.14118 172.21.15.29:0/3812793991' entity='mgr.x' 2024-09-19T06:59:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:07 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1629864355' entity='client.admin' 2024-09-19T06:59:08.852 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:08 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1492240767' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T06:59:08.852 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: ignoring --setuser ceph since I am not root 2024-09-19T06:59:08.853 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: ignoring --setgroup ceph since I am not root 2024-09-19T06:59:08.853 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:08.811+0000 7fa45815a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:59:09.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:08.871+0000 7fa45815a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:59:09.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.026+0000 7fa45815a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:59:09.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.095+0000 7fa45815a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:59:09.544 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.253+0000 7fa45815a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:59:09.545 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.401+0000 7fa45815a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:59:09.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1492240767' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T06:59:09.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-mon[31255]: mgrmap e9: x(active, since 20s) 2024-09-19T06:59:09.800 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.734+0000 7fa45815a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:59:09.801 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.798+0000 7fa45815a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:59:09.948 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f319c1d3640 1 Processor -- start 2024-09-19T06:59:09.948 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f319c1d3640 1 -- start start 2024-09-19T06:59:09.948 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f319c1d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f3194108e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:09.948 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f319c1d3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3194107040 con 0x7f3194108a60 2024-09-19T06:59:09.948 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f3199f6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f3194108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:09.948 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f3199f6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f3194108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34654/0 (socket says 172.21.15.29:34654) 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.057+0000 7f3199f6f640 1 -- 172.21.15.29:0/3572184710 learned_addr learned my addr 172.21.15.29:0/3572184710 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.058+0000 7f3199f6f640 1 -- 172.21.15.29:0/3572184710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941071c0 con 0x7f3194108a60 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.058+0000 7f3199f6f640 1 --2- 172.21.15.29:0/3572184710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f3194108e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3190009820 tx=0x7f319002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82161825e8c07c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.058+0000 7f3198f6d640 1 -- 172.21.15.29:0/3572184710 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190037070 con 0x7f3194108a60 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f3198f6d640 1 -- 172.21.15.29:0/3572184710 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31900328f0 con 0x7f3194108a60 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f3198f6d640 1 -- 172.21.15.29:0/3572184710 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190030740 con 0x7f3194108a60 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 -- 172.21.15.29:0/3572184710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 msgr2=0x7f3194108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 --2- 172.21.15.29:0/3572184710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f3194108e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3190009820 tx=0x7f319002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 -- 172.21.15.29:0/3572184710 shutdown_connections 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 --2- 172.21.15.29:0/3572184710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f3194108e60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 -- 172.21.15.29:0/3572184710 >> 172.21.15.29:0/3572184710 conn(0x7f3194102b70 msgr2=0x7f3194104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 -- 172.21.15.29:0/3572184710 shutdown_connections 2024-09-19T06:59:09.949 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.059+0000 7f319c1d3640 1 -- 172.21.15.29:0/3572184710 wait complete. 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f319c1d3640 1 Processor -- start 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f319c1d3640 1 -- start start 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f319c1d3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f319419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f319c1d3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f319410b930 con 0x7f3194108a60 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f3199f6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f319419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f3199f6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f319419b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34670/0 (socket says 172.21.15.29:34670) 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f3199f6f640 1 -- 172.21.15.29:0/1492240767 learned_addr learned my addr 172.21.15.29:0/1492240767 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f3199f6f640 1 -- 172.21.15.29:0/1492240767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319419bc60 con 0x7f3194108a60 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.060+0000 7f3199f6f640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f319419b720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3190009940 tx=0x7f3190030cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.061+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190042070 con 0x7f3194108a60 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.061+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3190030e30 con 0x7f3194108a60 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.061+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319419bef0 con 0x7f3194108a60 2024-09-19T06:59:09.950 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.061+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3190037040 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.061+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319419ebe0 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.061+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f3190045070 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.062+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3194108ee0 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.062+0000 7f318affd640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3180039200 0x7f318003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.062+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f319006c370 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.062+0000 7f319976e640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3180039200 0x7f318003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.062+0000 7f319976e640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3180039200 0x7f318003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31840098c0 tx=0x7f3184006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.066+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f319003c650 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.299+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f3194068640 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.654+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f319004b170 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.656+0000 7f318affd640 1 -- 172.21.15.29:0/1492240767 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f319003d950 con 0x7f3194108a60 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.657+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3180039200 msgr2=0x7f318003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.657+0000 7f319c1d3640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3180039200 0x7f318003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f31840098c0 tx=0x7f3184006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:09.951 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 msgr2=0x7f319419b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f319419b720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3190009940 tx=0x7f3190030cc0 comp rx=0 tx=0).stop 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 shutdown_connections 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f3180039200 0x7f318003b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 --2- 172.21.15.29:0/1492240767 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3194108a60 0x7f319419b720 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 >> 172.21.15.29:0/1492240767 conn(0x7f3194102b70 msgr2=0x7f3194103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 shutdown_connections 2024-09-19T06:59:09.952 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:08.658+0000 7f319c1d3640 1 -- 172.21.15.29:0/1492240767 wait complete. 2024-09-19T06:59:10.067 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:09.998+0000 7fa45815a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:59:10.946 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:10 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1645238411' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:59:11.265 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:10.944+0000 7fa45815a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:59:11.265 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:11 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:11.016+0000 7fa45815a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cba1d6640 1 Processor -- start 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cba1d6640 1 -- start start 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cba1d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb410a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cba1d6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb40757a0 con 0x7f9cb4107dc0 2024-09-19T06:59:11.273 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cb37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb410a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cb37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb410a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34708/0 (socket says 172.21.15.29:34708) 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cb37fe640 1 -- 172.21.15.29:0/1036739797 learned_addr learned my addr 172.21.15.29:0/1036739797 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.427+0000 7f9cb37fe640 1 -- 172.21.15.29:0/1036739797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb410a6f0 con 0x7f9cb4107dc0 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.428+0000 7f9cb37fe640 1 --2- 172.21.15.29:0/1036739797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb410a1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009820 tx=0x7f9ca402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4058ca0b090f50c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.428+0000 7f9cb27fc640 1 -- 172.21.15.29:0/1036739797 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4037070 con 0x7f9cb4107dc0 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.428+0000 7f9cb27fc640 1 -- 172.21.15.29:0/1036739797 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ca40328f0 con 0x7f9cb4107dc0 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.428+0000 7f9cb27fc640 1 -- 172.21.15.29:0/1036739797 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4030740 con 0x7f9cb4107dc0 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1036739797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 msgr2=0x7f9cb410a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 --2- 172.21.15.29:0/1036739797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb410a1b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009820 tx=0x7f9ca402a270 comp rx=0 tx=0).stop 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1036739797 shutdown_connections 2024-09-19T06:59:11.274 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 --2- 172.21.15.29:0/1036739797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb410a1b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1036739797 >> 172.21.15.29:0/1036739797 conn(0x7f9cb41019a0 msgr2=0x7f9cb4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1036739797 shutdown_connections 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.429+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1036739797 wait complete. 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.430+0000 7f9cba1d6640 1 Processor -- start 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.430+0000 7f9cba1d6640 1 -- start start 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.430+0000 7f9cba1d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb4107640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.430+0000 7f9cba1d6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb410b770 con 0x7f9cb4107dc0 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb4107640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb4107640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34724/0 (socket says 172.21.15.29:34724) 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb37fe640 1 -- 172.21.15.29:0/1645238411 learned_addr learned my addr 172.21.15.29:0/1645238411 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb37fe640 1 -- 172.21.15.29:0/1645238411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb4107b80 con 0x7f9cb4107dc0 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb37fe640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb4107640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4030cc0 tx=0x7f9ca4030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4042070 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb4105d70 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ca4030e60 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4037040 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.431+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb41062b0 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.432+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f9ca4045070 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.433+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb4108220 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.433+0000 7f9cb0ff9640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.433+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9ca406c340 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.433+0000 7f9cb2ffd640 1 -- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 msgr2=0x7f9c9c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1256989766 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.433+0000 7f9cb2ffd640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.438+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ca404b170 con 0x7f9cb4107dc0 2024-09-19T06:59:11.276 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.634+0000 7f9cb2ffd640 1 -- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 msgr2=0x7f9c9c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1256989766 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.634+0000 7f9cb2ffd640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.661+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9cb4194d40 con 0x7f9cb4107dc0 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.661+0000 7f9cb0ff9640 1 -- 172.21.15.29:0/1645238411 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f9ca403c630 con 0x7f9cb4107dc0 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 msgr2=0x7f9c9c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 msgr2=0x7f9cb4107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb4107640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4030cc0 tx=0x7f9ca4030cf0 comp rx=0 tx=0).stop 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 shutdown_connections 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f9c9c039260 0x7f9c9c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 --2- 172.21.15.29:0/1645238411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cb4107dc0 0x7f9cb4107640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.663+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 >> 172.21.15.29:0/1645238411 conn(0x7f9cb41019a0 msgr2=0x7f9cb41026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.664+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 shutdown_connections 2024-09-19T06:59:11.277 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:10.664+0000 7f9cba1d6640 1 -- 172.21.15.29:0/1645238411 wait complete. 2024-09-19T06:59:11.278 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for the mgr to restart... 2024-09-19T06:59:11.278 INFO:teuthology.orchestra.run.smithi029.stdout:Waiting for mgr epoch 9... 2024-09-19T06:59:11.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:11 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:11.780+0000 7fa45815a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:59:12.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:11 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:11.902+0000 7fa45815a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:59:12.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.052+0000 7fa45815a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:59:12.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.116+0000 7fa45815a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:59:12.574 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.272+0000 7fa45815a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:59:12.574 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.343+0000 7fa45815a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:59:12.574 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.406+0000 7fa45815a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:59:12.574 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.572+0000 7fa45815a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:59:12.860 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.640+0000 7fa45815a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:59:12.860 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.710+0000 7fa45815a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:59:12.861 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.796+0000 7fa45815a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:59:12.861 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.858+0000 7fa45815a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:59:13.124 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:12 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:12.920+0000 7fa45815a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:59:14.004 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:13.751+0000 7fa45815a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:59:14.004 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: Active manager daemon x restarted 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: Activating manager daemon x 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: mgrmap e10: x(active, starting, since 0.00308668s) 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: Manager daemon x is now available 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:59:14.005 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65dc5df640 1 Processor -- start 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65dc5df640 1 -- start start 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65dc5df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d410a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65dc5df640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40757a0 con 0x7f65d4107dd0 2024-09-19T06:59:15.720 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65da37b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d410a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65da37b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d410a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34728/0 (socket says 172.21.15.29:34728) 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.665+0000 7f65da37b640 1 -- 172.21.15.29:0/2777995513 learned_addr learned my addr 172.21.15.29:0/2777995513 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.666+0000 7f65da37b640 1 -- 172.21.15.29:0/2777995513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d410a700 con 0x7f65d4107dd0 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.666+0000 7f65da37b640 1 --2- 172.21.15.29:0/2777995513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d410a1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009820 tx=0x7f65d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de7808e7bb56b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65d9379640 1 -- 172.21.15.29:0/2777995513 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d0037070 con 0x7f65d4107dd0 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65d9379640 1 -- 172.21.15.29:0/2777995513 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65d00328f0 con 0x7f65d4107dd0 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65d9379640 1 -- 172.21.15.29:0/2777995513 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d0030740 con 0x7f65d4107dd0 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65dc5df640 1 -- 172.21.15.29:0/2777995513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 msgr2=0x7f65d410a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2777995513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d410a1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009820 tx=0x7f65d002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65dc5df640 1 -- 172.21.15.29:0/2777995513 shutdown_connections 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.667+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2777995513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d410a1c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 -- 172.21.15.29:0/2777995513 >> 172.21.15.29:0/2777995513 conn(0x7f65d41019b0 msgr2=0x7f65d4103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:15.721 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 -- 172.21.15.29:0/2777995513 shutdown_connections 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 -- 172.21.15.29:0/2777995513 wait complete. 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 Processor -- start 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 -- start start 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.668+0000 7f65dc5df640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f65d4106a10 con 0x7f65d4107dd0 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65da37b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65da37b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34740/0 (socket says 172.21.15.29:34740) 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65da37b640 1 -- 172.21.15.29:0/2411816734 learned_addr learned my addr 172.21.15.29:0/2411816734 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65da37b640 1 -- 172.21.15.29:0/2411816734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d419dd50 con 0x7f65d4107dd0 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65da37b640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d419d810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65d0030cc0 tx=0x7f65d0030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d0042070 con 0x7f65d4107dd0 2024-09-19T06:59:15.722 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d419dfe0 con 0x7f65d4107dd0 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65d0030e60 con 0x7f65d4107dd0 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65d0037040 con 0x7f65d4107dd0 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.669+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d41a0cd0 con 0x7f65d4107dd0 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.670+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f65d0045070 con 0x7f65d4107dd0 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.670+0000 7f65cb7fe640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.671+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 --> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f65c003bdd0 con 0x7f65c0039200 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.671+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f65d006c4e0 con 0x7f65d4107dd0 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.671+0000 7f65d9b7a640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 msgr2=0x7f65c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1256989766 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.671+0000 7f65d9b7a640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.872+0000 7f65d9b7a640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 msgr2=0x7f65c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1256989766 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:11.872+0000 7f65d9b7a640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:59:15.723 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:12.273+0000 7f65d9b7a640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 msgr2=0x7f65c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1256989766 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:12.273+0000 7f65d9b7a640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:13.075+0000 7f65d9b7a640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 msgr2=0x7f65c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.29:6800/1256989766 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:13.075+0000 7f65d9b7a640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:13.754+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f65d006af90 con 0x7f65d4107dd0 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:13.754+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 msgr2=0x7f65c003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:13.754+0000 7f65cb7fe640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.756+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f65d00442c0 con 0x7f65d4107dd0 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.756+0000 7f65cb7fe640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f65c003ccc0 0x7f65c003f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.756+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f65c003bdd0 con 0x7f65c003ccc0 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.756+0000 7f65d9b7a640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f65c003ccc0 0x7f65c003f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:15.724 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.757+0000 7f65d9b7a640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f65c003ccc0 0x7f65c003f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f65c4003980 tx=0x7f65c4006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.758+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f65c003bdd0 con 0x7f65c003ccc0 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.770+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f65d4107090 con 0x7f65c003ccc0 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.770+0000 7f65cb7fe640 1 -- 172.21.15.29:0/2411816734 <== mgr.14150 v2:172.21.15.29:6800/3056547780 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f65d4107090 con 0x7f65c003ccc0 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f65c003ccc0 msgr2=0x7f65c003f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f65c003ccc0 0x7f65c003f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f65c4003980 tx=0x7f65c4006e10 comp rx=0 tx=0).stop 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 msgr2=0x7f65d419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d419d810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65d0030cc0 tx=0x7f65d0030cf0 comp rx=0 tx=0).stop 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 shutdown_connections 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f65c003ccc0 0x7f65c003f0b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:6800/1256989766,v1:172.21.15.29:6801/1256989766] conn(0x7f65c0039200 0x7f65c003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 --2- 172.21.15.29:0/2411816734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4107dd0 0x7f65d419d810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 >> 172.21.15.29:0/2411816734 conn(0x7f65d41019b0 msgr2=0x7f65d41026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:15.725 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 shutdown_connections 2024-09-19T06:59:15.726 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:14.771+0000 7f65dc5df640 1 -- 172.21.15.29:0/2411816734 wait complete. 2024-09-19T06:59:15.726 INFO:teuthology.orchestra.run.smithi029.stdout:mgr epoch 9 is available 2024-09-19T06:59:15.726 INFO:teuthology.orchestra.run.smithi029.stdout:Generating a dashboard self-signed certificate... 2024-09-19T06:59:16.015 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:15 smithi029 ceph-mon[31255]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:59:16.015 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:15 smithi029 ceph-mon[31255]: mgrmap e11: x(active, since 1.00587s) 2024-09-19T06:59:16.015 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:15 smithi029 ceph-mon[31255]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:59:16.015 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:16.538 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:16.283+0000 7fa3c342e640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:59:16] ENGINE Error in HTTPServer.serve 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: Traceback (most recent call last): 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self._connections.run(self.expiration_interval) 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self._run(expiration_interval) 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:59:16.539 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: s = self.context.wrap_socket( 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: return self.sslsocket_class._create( 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self.do_handshake() 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: self._sslobj.do_handshake() 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:59:16.540 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: mgrmap e12: x(active, since 2s) 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: [19/Sep/2024:06:59:16] ENGINE Bus STARTING 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: [19/Sep/2024:06:59:16] ENGINE Serving on https://172.21.15.29:7150 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: [19/Sep/2024:06:59:16] ENGINE Error in HTTPServer.serve 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout: Traceback (most recent call last): 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:59:16.803 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._run(expiration_interval) 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: s = self.context.wrap_socket( 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: return self.sslsocket_class._create( 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:59:16.804 INFO:journalctl@ceph.mon.a.smithi029.stdout: self.do_handshake() 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout: self._sslobj.do_handshake() 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: [19/Sep/2024:06:59:16] ENGINE Serving on http://172.21.15.29:8765 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: [19/Sep/2024:06:59:16] ENGINE Bus STARTED 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:16.805 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:16 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:17.559 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b2fcc640 1 Processor -- start 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b2fcc640 1 -- start start 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b2fcc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac10a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b2fcc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac075740 con 0x7fa7ac107e20 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b0d68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac10a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b0d68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac10a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34726/0 (socket says 172.21.15.29:34726) 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.206+0000 7fa7b0d68640 1 -- 172.21.15.29:0/3015049901 learned_addr learned my addr 172.21.15.29:0/3015049901 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.207+0000 7fa7b0d68640 1 -- 172.21.15.29:0/3015049901 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac10a750 con 0x7fa7ac107e20 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.207+0000 7fa7b0d68640 1 --2- 172.21.15.29:0/3015049901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac10a210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009820 tx=0x7fa79c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3177869c769d189 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:17.560 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.207+0000 7fa7ab7fe640 1 -- 172.21.15.29:0/3015049901 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79c037070 con 0x7fa7ac107e20 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7ab7fe640 1 -- 172.21.15.29:0/3015049901 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa79c0328f0 con 0x7fa7ac107e20 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7ab7fe640 1 -- 172.21.15.29:0/3015049901 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79c030740 con 0x7fa7ac107e20 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3015049901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 msgr2=0x7fa7ac10a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 --2- 172.21.15.29:0/3015049901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac10a210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa79c009820 tx=0x7fa79c02a270 comp rx=0 tx=0).stop 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3015049901 shutdown_connections 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 --2- 172.21.15.29:0/3015049901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac10a210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3015049901 >> 172.21.15.29:0/3015049901 conn(0x7fa7ac1019a0 msgr2=0x7fa7ac103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3015049901 shutdown_connections 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.208+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3015049901 wait complete. 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b2fcc640 1 Processor -- start 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b2fcc640 1 -- start start 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b2fcc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:17.561 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b2fcc640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10b770 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b0d68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b0d68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac19b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34738/0 (socket says 172.21.15.29:34738) 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b0d68640 1 -- 172.21.15.29:0/3462585605 learned_addr learned my addr 172.21.15.29:0/3462585605 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.209+0000 7fa7b0d68640 1 -- 172.21.15.29:0/3462585605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac19bb20 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.210+0000 7fa7b0d68640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac19b5e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa79c030cc0 tx=0x7fa79c030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.210+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79c042070 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.210+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac19bdb0 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.210+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa79c030e60 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.210+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79c037040 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.210+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac19eaa0 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.211+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fa79c045070 con 0x7fa7ac107e20 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.211+0000 7fa7a9ffb640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa794039200 0x7fa79403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:17.562 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.211+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa79c03d430 con 0x7fa7ac107e20 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.211+0000 7fa7abfff640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa794039200 0x7fa79403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.211+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac108280 con 0x7fa7ac107e20 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.211+0000 7fa7abfff640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa794039200 0x7fa79403b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00098c0 tx=0x7fa7a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.216+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa79c02ed90 con 0x7fa7ac107e20 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.407+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa7ac062630 con 0x7fa794039200 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.484+0000 7fa7a9ffb640 1 -- 172.21.15.29:0/3462585605 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa7ac062630 con 0x7fa794039200 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa794039200 msgr2=0x7fa79403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa794039200 0x7fa79403b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7a00098c0 tx=0x7fa7a0006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 msgr2=0x7fa7ac19b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac19b5e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa79c030cc0 tx=0x7fa79c030cf0 comp rx=0 tx=0).stop 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 shutdown_connections 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa794039200 0x7fa79403b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 --2- 172.21.15.29:0/3462585605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7ac107e20 0x7fa7ac19b5e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:17.563 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 >> 172.21.15.29:0/3462585605 conn(0x7fa7ac1019a0 msgr2=0x7fa7ac1026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:17.564 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 shutdown_connections 2024-09-19T06:59:17.564 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:16.487+0000 7fa7b2fcc640 1 -- 172.21.15.29:0/3462585605 wait complete. 2024-09-19T06:59:17.564 INFO:teuthology.orchestra.run.smithi029.stdout:Creating initial admin user... 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$S009W4RNwxJ2BqrZYX/7FeC7OP41.In/Q33tAfTwbv1rss3P.0Q7K", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726729158, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.985+0000 7fbcd5119640 1 Processor -- start 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.985+0000 7fbcd5119640 1 -- start start 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.985+0000 7fbcd5119640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd010a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.985+0000 7fbcd5119640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd00757a0 con 0x7fbcd0107dc0 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.986+0000 7fbcced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd010a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:19.080 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.986+0000 7fbcced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd010a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34746/0 (socket says 172.21.15.29:34746) 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.986+0000 7fbcced9d640 1 -- 172.21.15.29:0/4123626993 learned_addr learned my addr 172.21.15.29:0/4123626993 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.986+0000 7fbcced9d640 1 -- 172.21.15.29:0/4123626993 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd010a6f0 con 0x7fbcd0107dc0 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbcced9d640 1 --2- 172.21.15.29:0/4123626993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd010a1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009820 tx=0x7fbcc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18baea1a4bd3962e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbccdd9b640 1 -- 172.21.15.29:0/4123626993 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc0037070 con 0x7fbcd0107dc0 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbccdd9b640 1 -- 172.21.15.29:0/4123626993 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc00328f0 con 0x7fbcd0107dc0 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbccdd9b640 1 -- 172.21.15.29:0/4123626993 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc0030740 con 0x7fbcd0107dc0 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbcd5119640 1 -- 172.21.15.29:0/4123626993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 msgr2=0x7fbcd010a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbcd5119640 1 --2- 172.21.15.29:0/4123626993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd010a1b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009820 tx=0x7fbcc002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbcd5119640 1 -- 172.21.15.29:0/4123626993 shutdown_connections 2024-09-19T06:59:19.081 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbcd5119640 1 --2- 172.21.15.29:0/4123626993 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd010a1b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.987+0000 7fbcd5119640 1 -- 172.21.15.29:0/4123626993 >> 172.21.15.29:0/4123626993 conn(0x7fbcd01019a0 msgr2=0x7fbcd0103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.988+0000 7fbcd5119640 1 -- 172.21.15.29:0/4123626993 shutdown_connections 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.988+0000 7fbcd5119640 1 -- 172.21.15.29:0/4123626993 wait complete. 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.988+0000 7fbcd5119640 1 Processor -- start 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcd5119640 1 -- start start 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcd5119640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcd5119640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd010b770 con 0x7fbcd0107dc0 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcced9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd019b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34760/0 (socket says 172.21.15.29:34760) 2024-09-19T06:59:19.082 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcced9d640 1 -- 172.21.15.29:0/2842884376 learned_addr learned my addr 172.21.15.29:0/2842884376 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcced9d640 1 -- 172.21.15.29:0/2842884376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd019bb10 con 0x7fbcd0107dc0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.989+0000 7fbcced9d640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd019b5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00097f0 tx=0x7fbcc0030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.990+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc0042070 con 0x7fbcd0107dc0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.990+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcc0030d80 con 0x7fbcd0107dc0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.990+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd019bda0 con 0x7fbcd0107dc0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.990+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc0037040 con 0x7fbcd0107dc0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.990+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd019ea90 con 0x7fbcd0107dc0 2024-09-19T06:59:19.083 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.991+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fbcc0045070 con 0x7fbcd0107dc0 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.991+0000 7fbcb7fff640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcb8039200 0x7fbcb803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.991+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbcc006c490 con 0x7fbcd0107dc0 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.991+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd0108220 con 0x7fbcd0107dc0 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.991+0000 7fbcce59c640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcb8039200 0x7fbcb803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.991+0000 7fbcce59c640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcb8039200 0x7fbcb803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40098c0 tx=0x7fbcc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:17.996+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcc0045520 con 0x7fbcd0107dc0 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.191+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fbcd0193aa0 con 0x7fbcb8039200 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.439+0000 7fbcb7fff640 1 -- 172.21.15.29:0/2842884376 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fbcd0193aa0 con 0x7fbcb8039200 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.441+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcb8039200 msgr2=0x7fbcb803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:19.084 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.441+0000 7fbcd5119640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcb8039200 0x7fbcb803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40098c0 tx=0x7fbcc4006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.441+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 msgr2=0x7fbcd019b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.441+0000 7fbcd5119640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd019b5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00097f0 tx=0x7fbcc0030c70 comp rx=0 tx=0).stop 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.441+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 shutdown_connections 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.442+0000 7fbcd5119640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcb8039200 0x7fbcb803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.442+0000 7fbcd5119640 1 --2- 172.21.15.29:0/2842884376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcd0107dc0 0x7fbcd019b5d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.442+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 >> 172.21.15.29:0/2842884376 conn(0x7fbcd01019a0 msgr2=0x7fbcd0102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.442+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 shutdown_connections 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:18.442+0000 7fbcd5119640 1 -- 172.21.15.29:0/2842884376 wait complete. 2024-09-19T06:59:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:Fetching dashboard port number... 2024-09-19T06:59:19.484 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:19 smithi029 ceph-mon[31255]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:19.485 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.483+0000 7f4214f95640 1 Processor -- start 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f4214f95640 1 -- start start 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f4214f95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f4210108e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f4214f95640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4210107040 con 0x7f4210108a60 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f420e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f4210108e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:20.303 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f420e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f4210108e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34768/0 (socket says 172.21.15.29:34768) 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f420e59c640 1 -- 172.21.15.29:0/4251206655 learned_addr learned my addr 172.21.15.29:0/4251206655 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.484+0000 7f420e59c640 1 -- 172.21.15.29:0/4251206655 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42101071c0 con 0x7f4210108a60 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.485+0000 7f420e59c640 1 --2- 172.21.15.29:0/4251206655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f4210108e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4200009820 tx=0x7f420002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323cafae13718920 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.485+0000 7f420dd9b640 1 -- 172.21.15.29:0/4251206655 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4200037070 con 0x7f4210108a60 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.485+0000 7f420dd9b640 1 -- 172.21.15.29:0/4251206655 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f42000328f0 con 0x7f4210108a60 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.485+0000 7f420dd9b640 1 -- 172.21.15.29:0/4251206655 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4200030740 con 0x7f4210108a60 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 -- 172.21.15.29:0/4251206655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 msgr2=0x7f4210108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 --2- 172.21.15.29:0/4251206655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f4210108e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4200009820 tx=0x7f420002a270 comp rx=0 tx=0).stop 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 -- 172.21.15.29:0/4251206655 shutdown_connections 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 --2- 172.21.15.29:0/4251206655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f4210108e60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 -- 172.21.15.29:0/4251206655 >> 172.21.15.29:0/4251206655 conn(0x7f4210102b70 msgr2=0x7f4210104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:20.304 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 -- 172.21.15.29:0/4251206655 shutdown_connections 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 -- 172.21.15.29:0/4251206655 wait complete. 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.486+0000 7f4214f95640 1 Processor -- start 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f4214f95640 1 -- start start 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f4214f95640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f421019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f4214f95640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f421010b930 con 0x7f4210108a60 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f420e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f421019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f420e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f421019b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34776/0 (socket says 172.21.15.29:34776) 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f420e59c640 1 -- 172.21.15.29:0/4251388867 learned_addr learned my addr 172.21.15.29:0/4251388867 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f420e59c640 1 -- 172.21.15.29:0/4251388867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421019bc60 con 0x7f4210108a60 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f420e59c640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f421019b720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42000097f0 tx=0x7f4200030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4200042070 con 0x7f4210108a60 2024-09-19T06:59:20.305 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421019bef0 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4200030d80 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.487+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4200037040 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.488+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421019ebe0 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.489+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f4200045070 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.489+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4210108ee0 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.489+0000 7f42077fe640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41fc039200 0x7f41fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.489+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f420006c550 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.489+0000 7f4207fff640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41fc039200 0x7f41fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.489+0000 7f4207fff640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41fc039200 0x7f41fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41f80098c0 tx=0x7f41f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.494+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4200045360 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.670+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f4210068640 con 0x7f4210108a60 2024-09-19T06:59:20.306 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.670+0000 7f42077fe640 1 -- 172.21.15.29:0/4251388867 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f420003bdf0 con 0x7f4210108a60 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41fc039200 msgr2=0x7f41fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41fc039200 0x7f41fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41f80098c0 tx=0x7f41f8006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 msgr2=0x7f421019b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f421019b720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42000097f0 tx=0x7f4200030c70 comp rx=0 tx=0).stop 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 shutdown_connections 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41fc039200 0x7f41fc03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 --2- 172.21.15.29:0/4251388867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4210108a60 0x7f421019b720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 >> 172.21.15.29:0/4251388867 conn(0x7f4210102b70 msgr2=0x7f4210103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 shutdown_connections 2024-09-19T06:59:20.307 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:19.673+0000 7f4214f95640 1 -- 172.21.15.29:0/4251388867 wait complete. 2024-09-19T06:59:20.311 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:59:20.311 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout disabled 2024-09-19T06:59:20.318 INFO:teuthology.orchestra.run.smithi029.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:59:20.319 INFO:teuthology.orchestra.run.smithi029.stdout:systemctl: stdout inactive 2024-09-19T06:59:20.319 INFO:teuthology.orchestra.run.smithi029.stdout:firewalld.service is not enabled 2024-09-19T06:59:20.319 INFO:teuthology.orchestra.run.smithi029.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T06:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout:Ceph Dashboard is now available at: 2024-09-19T06:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout: URL: https://smithi029.front.sepia.ceph.com:8443/ 2024-09-19T06:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout: User: admin 2024-09-19T06:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout: Password: v7vvxjsaac 2024-09-19T06:59:20.321 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:20.322 INFO:teuthology.orchestra.run.smithi029.stdout:Saving cluster configuration to /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config directory 2024-09-19T06:59:20.564 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:20 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4251388867' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T06:59:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:21 smithi029 ceph-mon[31255]: mgrmap e13: x(active, since 6s) 2024-09-19T06:59:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:21 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3211198939' entity='client.admin' 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.753+0000 7f1f326e8640 1 Processor -- start 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.753+0000 7f1f326e8640 1 -- start start 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.753+0000 7f1f326e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c10a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.753+0000 7f1f326e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c07be10 con 0x7f1f2c107e30 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.753+0000 7f1f2bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c10a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.754+0000 7f1f2bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c10a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34786/0 (socket says 172.21.15.29:34786) 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.754+0000 7f1f2bfff640 1 -- 172.21.15.29:0/871642492 learned_addr learned my addr 172.21.15.29:0/871642492 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.754+0000 7f1f2bfff640 1 -- 172.21.15.29:0/871642492 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c10a760 con 0x7f1f2c107e30 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.754+0000 7f1f2bfff640 1 --2- 172.21.15.29:0/871642492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c10a220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009820 tx=0x7f1f1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3469507a0aa06a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:21.644 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f2affd640 1 -- 172.21.15.29:0/871642492 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1c037070 con 0x7f1f2c107e30 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f2affd640 1 -- 172.21.15.29:0/871642492 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f1c0328f0 con 0x7f1f2c107e30 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f2affd640 1 -- 172.21.15.29:0/871642492 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1c030740 con 0x7f1f2c107e30 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 -- 172.21.15.29:0/871642492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 msgr2=0x7f1f2c10a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 --2- 172.21.15.29:0/871642492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c10a220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009820 tx=0x7f1f1c02a270 comp rx=0 tx=0).stop 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 -- 172.21.15.29:0/871642492 shutdown_connections 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 --2- 172.21.15.29:0/871642492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c10a220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 -- 172.21.15.29:0/871642492 >> 172.21.15.29:0/871642492 conn(0x7f1f2c1019d0 msgr2=0x7f1f2c103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 -- 172.21.15.29:0/871642492 shutdown_connections 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.755+0000 7f1f326e8640 1 -- 172.21.15.29:0/871642492 wait complete. 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.756+0000 7f1f326e8640 1 Processor -- start 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.756+0000 7f1f326e8640 1 -- start start 2024-09-19T06:59:21.645 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.756+0000 7f1f326e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.756+0000 7f1f326e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c10b780 con 0x7f1f2c107e30 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f2bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f2bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c19b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34788/0 (socket says 172.21.15.29:34788) 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f2bfff640 1 -- 172.21.15.29:0/3211198939 learned_addr learned my addr 172.21.15.29:0/3211198939 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f2bfff640 1 -- 172.21.15.29:0/3211198939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c19bb40 con 0x7f1f2c107e30 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f2bfff640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c19b600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0327b0 tx=0x7f1f1c0327e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1c042070 con 0x7f1f2c107e30 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f1c030d50 con 0x7f1f2c107e30 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1c037040 con 0x7f1f2c107e30 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c19bdd0 con 0x7f1f2c107e30 2024-09-19T06:59:21.646 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.757+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c19eac0 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.758+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1f1c045070 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.759+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c108290 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.759+0000 7f1f297fa640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1f140392a0 0x7f1f1403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.759+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1f1c06c4a0 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.759+0000 7f1f2b7fe640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1f140392a0 0x7f1f1403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.759+0000 7f1f2b7fe640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1f140392a0 0x7f1f1403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f200098c0 tx=0x7f1f20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:20.764+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f1c04b170 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.037+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f1f2c02d7c0 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.039+0000 7f1f297fa640 1 -- 172.21.15.29:0/3211198939 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f1f1c03d430 con 0x7f1f2c107e30 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1f140392a0 msgr2=0x7f1f1403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:21.647 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1f140392a0 0x7f1f1403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1f200098c0 tx=0x7f1f20006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 msgr2=0x7f1f2c19b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c19b600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0327b0 tx=0x7f1f1c0327e0 comp rx=0 tx=0).stop 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 shutdown_connections 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1f140392a0 0x7f1f1403b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 --2- 172.21.15.29:0/3211198939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f2c107e30 0x7f1f2c19b600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.041+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 >> 172.21.15.29:0/3211198939 conn(0x7f1f2c1019d0 msgr2=0x7f1f2c1026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.042+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 shutdown_connections 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:/usr/bin/ceph: stderr 2024-09-19T06:59:21.042+0000 7f1f326e8640 1 -- 172.21.15.29:0/3211198939 wait complete. 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:21.648 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: ceph telemetry on 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout:For more information see: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:21.649 INFO:teuthology.orchestra.run.smithi029.stdout:Bootstrap complete. 2024-09-19T06:59:21.688 INFO:tasks.cephadm:Fetching config... 2024-09-19T06:59:21.688 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:59:21.688 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T06:59:21.706 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T06:59:21.706 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:59:21.706 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T06:59:21.762 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T06:59:21.762 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:59:21.762 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T06:59:21.829 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T06:59:21.830 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T06:59:21.830 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T06:59:21.885 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T06:59:21.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:59:21.965 INFO:teuthology.orchestra.run.smithi029.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:21.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:59:22.024 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:22.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:59:22.084 INFO:teuthology.orchestra.run.smithi078.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDzf714UYxUwX8GTxtCfiKObUX3ruTkGud8lyBeK1y3NZNQgLn/OOV4d8NG+Dg+a+nTTS+d5uuHYUBEeTIhx2NtEUd3V7tWE9RhJCiSj9WwQgcM0gnmKNSM1fOWXi9MK8L53cNDHZ3P43ilw88XIlCxch5EpK0rnOqqw8gFMTE7wvmgdoUGiPZysZ1bOFw2ohTCn6yELvBzH65mZ4kPxojPfRbUaGtxfyxOCvfTdOo2SPk+NXeUT3eNiA5+I2dQqmI9EEcl5a7h7BE471BryNyoooujOQFqeH5F1u7B7suFuH4vWFJ7iwQ03sQESPNG/SjwKeOFs5mSBREjBD7RfY5VrhG+0gpaCWuEuxJMQw6/DyJTngUjUcdbG0z95fZcprKNxD/gVsM3+Du84HKKpyJVA5AmX0szW9fqPfTFrnur06EjBXTS+SqkyC72ib+ElWYses3vE382EFR0cw08GTU8Y7nxFuqPCIDoatvg4zNJ3doY6FJ8Xy39FkRm7s7ndSs= ceph-6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:22.096 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T06:59:22.366 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:22.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 -- 172.21.15.29:0/4089274742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 msgr2=0x7f538c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 --2- 172.21.15.29:0/4089274742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f537c009880 tx=0x7f537c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 -- 172.21.15.29:0/4089274742 shutdown_connections 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 --2- 172.21.15.29:0/4089274742 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 -- 172.21.15.29:0/4089274742 >> 172.21.15.29:0/4089274742 conn(0x7f538c0fbcd0 msgr2=0x7f538c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 -- 172.21.15.29:0/4089274742 shutdown_connections 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.892+0000 7f5392236640 1 -- 172.21.15.29:0/4089274742 wait complete. 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f5392236640 1 Processor -- start 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f5392236640 1 -- start start 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f5392236640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:22.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f5392236640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f538c1064a0 con 0x7f538c100540 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f538b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f538b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c06a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34804/0 (socket says 172.21.15.29:34804) 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f538b7fe640 1 -- 172.21.15.29:0/3567534768 learned_addr learned my addr 172.21.15.29:0/3567534768 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f538b7fe640 1 -- 172.21.15.29:0/3567534768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c1999d0 con 0x7f538c100540 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.893+0000 7f538b7fe640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c06a170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f537c009230 tx=0x7f537c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.894+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f537c03f070 con 0x7f538c100540 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.894+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f537c003aa0 con 0x7f538c100540 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.894+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f537c035030 con 0x7f538c100540 2024-09-19T06:59:22.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.894+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c199ba0 con 0x7f538c100540 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.894+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c199fc0 con 0x7f538c100540 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.895+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f537c042070 con 0x7f538c100540 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.895+0000 7f5388ff9640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5374039300 0x7f537403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.895+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c106c20 con 0x7f538c100540 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.895+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f537c06d280 con 0x7f538c100540 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.895+0000 7f538affd640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5374039300 0x7f537403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:22.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.896+0000 7f538affd640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5374039300 0x7f537403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53800098c0 tx=0x7f5380006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:22.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:22.900+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f537c02f300 con 0x7f538c100540 2024-09-19T06:59:23.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.083+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f538c02d9c0 con 0x7f538c100540 2024-09-19T06:59:23.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.085+0000 7f5388ff9640 1 -- 172.21.15.29:0/3567534768 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f537c02fe30 con 0x7f538c100540 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5374039300 msgr2=0x7f537403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5374039300 0x7f537403b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f53800098c0 tx=0x7f5380006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 msgr2=0x7f538c06a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c06a170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f537c009230 tx=0x7f537c0048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 shutdown_connections 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5374039300 0x7f537403b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 --2- 172.21.15.29:0/3567534768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f538c100540 0x7f538c06a170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:23.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.088+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 >> 172.21.15.29:0/3567534768 conn(0x7f538c0fbcd0 msgr2=0x7f538c0fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:23.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.089+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 shutdown_connections 2024-09-19T06:59:23.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:23.089+0000 7f5392236640 1 -- 172.21.15.29:0/3567534768 wait complete. 2024-09-19T06:59:23.747 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T06:59:23.747 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T06:59:24.351 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:24 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3567534768' entity='client.admin' 2024-09-19T06:59:24.763 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 -- 172.21.15.29:0/3375115393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 msgr2=0x7f5948104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 --2- 172.21.15.29:0/3375115393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948104520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f593c009880 tx=0x7f593c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 -- 172.21.15.29:0/3375115393 shutdown_connections 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 --2- 172.21.15.29:0/3375115393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948104520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 -- 172.21.15.29:0/3375115393 >> 172.21.15.29:0/3375115393 conn(0x7f59480fbcd0 msgr2=0x7f59480fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 -- 172.21.15.29:0/3375115393 shutdown_connections 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 -- 172.21.15.29:0/3375115393 wait complete. 2024-09-19T06:59:25.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.253+0000 7f594eaee640 1 Processor -- start 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594eaee640 1 -- start start 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594eaee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594eaee640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5948107590 con 0x7f5948102130 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594c88a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594c88a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948196cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34814/0 (socket says 172.21.15.29:34814) 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594c88a640 1 -- 172.21.15.29:0/1468758433 learned_addr learned my addr 172.21.15.29:0/1468758433 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594c88a640 1 -- 172.21.15.29:0/1468758433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5948197210 con 0x7f5948102130 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.254+0000 7f594c88a640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948196cd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f593c009230 tx=0x7f593c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.255+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f593c03f070 con 0x7f5948102130 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.255+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f593c003aa0 con 0x7f5948102130 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.255+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59481974a0 con 0x7f5948102130 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.255+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f593c035030 con 0x7f5948102130 2024-09-19T06:59:25.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.255+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59480fff20 con 0x7f5948102130 2024-09-19T06:59:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.256+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f593c042070 con 0x7f5948102130 2024-09-19T06:59:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.256+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5948107d10 con 0x7f5948102130 2024-09-19T06:59:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.256+0000 7f5945ffb640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f593803d6b0 0x7f593803fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.256+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f593c06d100 con 0x7f5948102130 2024-09-19T06:59:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.257+0000 7f5947fff640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f593803d6b0 0x7f593803fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:25.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.257+0000 7f5947fff640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f593803d6b0 0x7f593803fb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f59340098c0 tx=0x7f5934006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:25.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.261+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f593c0433b0 con 0x7f5948102130 2024-09-19T06:59:25.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.445+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f5948062630 con 0x7f593803d6b0 2024-09-19T06:59:25.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.448+0000 7f5945ffb640 1 -- 172.21.15.29:0/1468758433 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5948062630 con 0x7f593803d6b0 2024-09-19T06:59:25.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f593803d6b0 msgr2=0x7f593803fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f593803d6b0 0x7f593803fb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f59340098c0 tx=0x7f5934006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 msgr2=0x7f5948196cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948196cd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f593c009230 tx=0x7f593c0048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 shutdown_connections 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f593803d6b0 0x7f593803fb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 --2- 172.21.15.29:0/1468758433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5948102130 0x7f5948196cd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.450+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 >> 172.21.15.29:0/1468758433 conn(0x7f59480fbcd0 msgr2=0x7f59480fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.451+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 shutdown_connections 2024-09-19T06:59:25.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:25.451+0000 7f594eaee640 1 -- 172.21.15.29:0/1468758433 wait complete. 2024-09-19T06:59:26.121 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi046 2024-09-19T06:59:26.121 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:59:26.121 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:59:26.141 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T06:59:26.141 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:26.201 INFO:tasks.cephadm:Adding host smithi046 to orchestrator... 2024-09-19T06:59:26.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch host add smithi046 2024-09-19T06:59:26.589 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:26.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:26 smithi029 ceph-mon[31255]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:26.711 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.125+0000 7f094f426640 1 -- 172.21.15.29:0/3787189303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 msgr2=0x7f0948100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.125+0000 7f094f426640 1 --2- 172.21.15.29:0/3787189303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948100940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0944009880 tx=0x7f094402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.125+0000 7f094f426640 1 -- 172.21.15.29:0/3787189303 shutdown_connections 2024-09-19T06:59:27.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.125+0000 7f094f426640 1 --2- 172.21.15.29:0/3787189303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948100940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.125+0000 7f094f426640 1 -- 172.21.15.29:0/3787189303 >> 172.21.15.29:0/3787189303 conn(0x7f09480fbcd0 msgr2=0x7f09480fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.126+0000 7f094f426640 1 -- 172.21.15.29:0/3787189303 shutdown_connections 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.126+0000 7f094f426640 1 -- 172.21.15.29:0/3787189303 wait complete. 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.126+0000 7f094f426640 1 Processor -- start 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.126+0000 7f094f426640 1 -- start start 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094f426640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094f426640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f09481064a0 con 0x7f0948100540 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094d1c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094d1c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53012/0 (socket says 172.21.15.29:53012) 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094d1c2640 1 -- 172.21.15.29:0/4189407956 learned_addr learned my addr 172.21.15.29:0/4189407956 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094d1c2640 1 -- 172.21.15.29:0/4189407956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09481971f0 con 0x7f0948100540 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094d1c2640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948196cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0944005ec0 tx=0x7f09440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f094403f070 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0944003aa0 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0944035030 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.127+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0948197480 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.128+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094819a170 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.128+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0948106c20 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.129+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0944042070 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.129+0000 7f093e7fc640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0934039300 0x7f093403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.129+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f094406d2d0 con 0x7f0948100540 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.129+0000 7f094c9c1640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0934039300 0x7f093403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.129+0000 7f094c9c1640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0934039300 0x7f093403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09380098c0 tx=0x7f0938006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.134+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f09440433b0 con 0x7f0948100540 2024-09-19T06:59:27.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:27.319+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi046", "target": ["mon-mgr", ""]}) -- 0x7f094802d830 con 0x7f0934039300 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi029", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:27.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:59:27.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:27.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:59:27.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:28 smithi029 ceph-mon[31255]: Updating smithi029:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:59:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:28 smithi029 ceph-mon[31255]: Updating smithi029:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:28 smithi029 ceph-mon[31255]: Updating smithi029:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:59:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:28 smithi029 ceph-mon[31255]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:29 smithi029 ceph-mon[31255]: Deploying cephadm binary to smithi046 2024-09-19T06:59:31.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.234+0000 7f093e7fc640 1 -- 172.21.15.29:0/4189407956 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f094802d830 con 0x7f0934039300 2024-09-19T06:59:31.235 INFO:teuthology.orchestra.run.smithi029.stdout:Added host 'smithi046' with addr '172.21.15.46' 2024-09-19T06:59:31.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0934039300 msgr2=0x7f093403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:31.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0934039300 0x7f093403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f09380098c0 tx=0x7f0938006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:31.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 msgr2=0x7f0948196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948196cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0944005ec0 tx=0x7f09440048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 shutdown_connections 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0934039300 0x7f093403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 --2- 172.21.15.29:0/4189407956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0948100540 0x7f0948196cb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 >> 172.21.15.29:0/4189407956 conn(0x7f09480fbcd0 msgr2=0x7f0948069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 shutdown_connections 2024-09-19T06:59:31.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:31.236+0000 7f094f426640 1 -- 172.21.15.29:0/4189407956 wait complete. 2024-09-19T06:59:31.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:59:32.138 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:32.484 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:32.484 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:32 smithi029 ceph-mon[31255]: Added host smithi046 2024-09-19T06:59:32.485 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:59:32.485 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:32.485 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 -- 172.21.15.29:0/3020912303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 msgr2=0x7fc344107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 --2- 172.21.15.29:0/3020912303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc334009880 tx=0x7fc33402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 -- 172.21.15.29:0/3020912303 shutdown_connections 2024-09-19T06:59:32.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 --2- 172.21.15.29:0/3020912303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 -- 172.21.15.29:0/3020912303 >> 172.21.15.29:0/3020912303 conn(0x7fc3440fd290 msgr2=0x7fc3440ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 -- 172.21.15.29:0/3020912303 shutdown_connections 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 -- 172.21.15.29:0/3020912303 wait complete. 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.566+0000 7fc349b83640 1 Processor -- start 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc349b83640 1 -- start start 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc349b83640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc349b83640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc34410bb40 con 0x7fc344107660 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc3437fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53032/0 (socket says 172.21.15.29:53032) 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc3437fe640 1 -- 172.21.15.29:0/3692804931 learned_addr learned my addr 172.21.15.29:0/3692804931 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc3437fe640 1 -- 172.21.15.29:0/3692804931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc344197580 con 0x7fc344107660 2024-09-19T06:59:32.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc3437fe640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344197040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc334009230 tx=0x7fc3340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.567+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33403f070 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.568+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc334004d10 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.568+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc344197810 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.568+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc334035030 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.568+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34419b910 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.568+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc334042070 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.569+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc344102cd0 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.569+0000 7fc340ff9640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc32c0392a0 0x7fc32c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.569+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc33406cfc0 con 0x7fc344107660 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.569+0000 7fc342ffd640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc32c0392a0 0x7fc32c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.569+0000 7fc342ffd640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc32c0392a0 0x7fc32c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3380098c0 tx=0x7fc338006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:32.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.574+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc334042360 con 0x7fc344107660 2024-09-19T06:59:32.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.754+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3441983a0 con 0x7fc32c0392a0 2024-09-19T06:59:32.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.755+0000 7fc340ff9640 1 -- 172.21.15.29:0/3692804931 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fc3441983a0 con 0x7fc32c0392a0 2024-09-19T06:59:32.756 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:32.756 INFO:teuthology.orchestra.run.smithi029.stdout:[{"addr": "172.21.15.29", "hostname": "smithi029", "labels": [], "status": ""}, {"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}] 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc32c0392a0 msgr2=0x7fc32c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc32c0392a0 0x7fc32c03b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc3380098c0 tx=0x7fc338006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 msgr2=0x7fc344197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344197040 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc334009230 tx=0x7fc3340048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 shutdown_connections 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc32c0392a0 0x7fc32c03b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:32.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 --2- 172.21.15.29:0/3692804931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc344107660 0x7fc344197040 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 >> 172.21.15.29:0/3692804931 conn(0x7fc3440fd290 msgr2=0x7fc3440fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 shutdown_connections 2024-09-19T06:59:32.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:32.758+0000 7fc349b83640 1 -- 172.21.15.29:0/3692804931 wait complete. 2024-09-19T06:59:33.451 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi078 2024-09-19T06:59:33.451 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:59:33.451 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:59:33.470 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T06:59:33.470 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:33.528 INFO:tasks.cephadm:Adding host smithi078 to orchestrator... 2024-09-19T06:59:33.528 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch host add smithi078 2024-09-19T06:59:33.781 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:33.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:33 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:34.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 -- 172.21.15.29:0/2998624616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 msgr2=0x7f125c102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 --2- 172.21.15.29:0/2998624616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c102b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1258009880 tx=0x7f125802a670 comp rx=0 tx=0).stop 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 -- 172.21.15.29:0/2998624616 shutdown_connections 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 --2- 172.21.15.29:0/2998624616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c102b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 -- 172.21.15.29:0/2998624616 >> 172.21.15.29:0/2998624616 conn(0x7f125c0fc1b0 msgr2=0x7f125c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 -- 172.21.15.29:0/2998624616 shutdown_connections 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.232+0000 7f1262f2b640 1 -- 172.21.15.29:0/2998624616 wait complete. 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1262f2b640 1 Processor -- start 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1262f2b640 1 -- start start 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1262f2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1262f2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f125c10bb70 con 0x7f125c102750 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1260cc7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:34.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1260cc7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c1970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:53064/0 (socket says 172.21.15.29:53064) 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.233+0000 7f1260cc7640 1 -- 172.21.15.29:0/1772534156 learned_addr learned my addr 172.21.15.29:0/1772534156 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1260cc7640 1 -- 172.21.15.29:0/1772534156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125c197630 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1260cc7640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c1970f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1258009230 tx=0x7f12580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125803f070 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1258004d10 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1258035030 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125c1978c0 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.234+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f125c197d20 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.235+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1258042070 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.235+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f125c06a7b0 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.235+0000 7f1251ffb640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1244039300 0x7f124403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.235+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f125806cf60 con 0x7f125c102750 2024-09-19T06:59:34.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.236+0000 7f1253fff640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1244039300 0x7f124403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:34.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.236+0000 7f1253fff640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1244039300 0x7f124403b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098c0 tx=0x7f124c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:34.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.240+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1258042360 con 0x7f125c102750 2024-09-19T06:59:34.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:34.418+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi078", "target": ["mon-mgr", ""]}) -- 0x7f125c198450 con 0x7f1244039300 2024-09-19T06:59:34.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:34 smithi029 ceph-mon[31255]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi078", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:59:35.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:35.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:59:36.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:36 smithi029 ceph-mon[31255]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T06:59:36.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:36 smithi029 ceph-mon[31255]: Deploying cephadm binary to smithi078 2024-09-19T06:59:36.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:36 smithi029 ceph-mon[31255]: Updating smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:59:36.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:36.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:36.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:37.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:37 smithi029 ceph-mon[31255]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:37.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:37 smithi029 ceph-mon[31255]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:37.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:37 smithi029 ceph-mon[31255]: Updating smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:59:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.377+0000 7f1251ffb640 1 -- 172.21.15.29:0/1772534156 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f125c198450 con 0x7f1244039300 2024-09-19T06:59:38.378 INFO:teuthology.orchestra.run.smithi029.stdout:Added host 'smithi078' with addr '172.21.15.78' 2024-09-19T06:59:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1244039300 msgr2=0x7f124403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1244039300 0x7f124403b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098c0 tx=0x7f124c006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 msgr2=0x7f125c1970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c1970f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1258009230 tx=0x7f12580048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 shutdown_connections 2024-09-19T06:59:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1244039300 0x7f124403b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 --2- 172.21.15.29:0/1772534156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f125c102750 0x7f125c1970f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 >> 172.21.15.29:0/1772534156 conn(0x7f125c0fc1b0 msgr2=0x7f125c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 shutdown_connections 2024-09-19T06:59:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:38.380+0000 7f1262f2b640 1 -- 172.21.15.29:0/1772534156 wait complete. 2024-09-19T06:59:39.033 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:59:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:39.656 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:39 smithi029 ceph-mon[31255]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:39.656 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:39.657 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:39 smithi029 ceph-mon[31255]: Added host smithi078 2024-09-19T06:59:39.657 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:59:39.657 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:39.657 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.740+0000 7fd444ce2640 1 -- 172.21.15.29:0/1775903095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 msgr2=0x7fd440106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.740+0000 7fd444ce2640 1 --2- 172.21.15.29:0/1775903095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd430009880 tx=0x7fd43002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:39.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.740+0000 7fd444ce2640 1 -- 172.21.15.29:0/1775903095 shutdown_connections 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.740+0000 7fd444ce2640 1 --2- 172.21.15.29:0/1775903095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.740+0000 7fd444ce2640 1 -- 172.21.15.29:0/1775903095 >> 172.21.15.29:0/1775903095 conn(0x7fd4400fc1b0 msgr2=0x7fd4400fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.741+0000 7fd444ce2640 1 -- 172.21.15.29:0/1775903095 shutdown_connections 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.741+0000 7fd444ce2640 1 -- 172.21.15.29:0/1775903095 wait complete. 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.741+0000 7fd444ce2640 1 Processor -- start 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.741+0000 7fd444ce2640 1 -- start start 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.741+0000 7fd444ce2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd444ce2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd44010aa40 con 0x7fd440106560 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd43e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd43e59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45598/0 (socket says 172.21.15.29:45598) 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd43e59c640 1 -- 172.21.15.29:0/2185742658 learned_addr learned my addr 172.21.15.29:0/2185742658 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd43e59c640 1 -- 172.21.15.29:0/2185742658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4401983d0 con 0x7fd440106560 2024-09-19T06:59:39.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd43e59c640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440197e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd430009230 tx=0x7fd4300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43003f070 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd440198660 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd430004d10 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd430035030 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.742+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd440198ac0 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.743+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd440101bd0 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.744+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd430042070 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.744+0000 7fd42f7fe640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd4280392a0 0x7fd42803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.744+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd43006d0e0 con 0x7fd440106560 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.744+0000 7fd43dd9b640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd4280392a0 0x7fd42803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.744+0000 7fd43dd9b640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd4280392a0 0x7fd42803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4340098c0 tx=0x7fd434006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:39.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.749+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4300303a0 con 0x7fd440106560 2024-09-19T06:59:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.938+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4401069c0 con 0x7fd4280392a0 2024-09-19T06:59:39.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.939+0000 7fd42f7fe640 1 -- 172.21.15.29:0/2185742658 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7fd4401069c0 con 0x7fd4280392a0 2024-09-19T06:59:39.940 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T06:59:39.940 INFO:teuthology.orchestra.run.smithi029.stdout:[{"addr": "172.21.15.29", "hostname": "smithi029", "labels": [], "status": ""}, {"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.78", "hostname": "smithi078", "labels": [], "status": ""}] 2024-09-19T06:59:39.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd4280392a0 msgr2=0x7fd42803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd4280392a0 0x7fd42803b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4340098c0 tx=0x7fd434006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 msgr2=0x7fd440197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440197e90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd430009230 tx=0x7fd4300048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 shutdown_connections 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd4280392a0 0x7fd42803b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 --2- 172.21.15.29:0/2185742658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd440106560 0x7fd440197e90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 >> 172.21.15.29:0/2185742658 conn(0x7fd4400fc1b0 msgr2=0x7fd4400fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 shutdown_connections 2024-09-19T06:59:39.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:39.941+0000 7fd444ce2640 1 -- 172.21.15.29:0/2185742658 wait complete. 2024-09-19T06:59:40.642 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T06:59:40.643 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T06:59:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:40 smithi029 ceph-mon[31255]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:40 smithi029 ceph-mon[31255]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:59:40.899 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:59:41.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 -- 172.21.15.29:0/1621901266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 msgr2=0x7f2e10102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:41.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 --2- 172.21.15.29:0/1621901266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10102b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009810 tx=0x7f2e0802a540 comp rx=0 tx=0).stop 2024-09-19T06:59:41.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 -- 172.21.15.29:0/1621901266 shutdown_connections 2024-09-19T06:59:41.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 --2- 172.21.15.29:0/1621901266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10102b10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 -- 172.21.15.29:0/1621901266 >> 172.21.15.29:0/1621901266 conn(0x7f2e10077310 msgr2=0x7f2e100fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 -- 172.21.15.29:0/1621901266 shutdown_connections 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 -- 172.21.15.29:0/1621901266 wait complete. 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 Processor -- start 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.346+0000 7f2e18413640 1 -- start start 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e18413640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e18413640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1010bb30 con 0x7f2e10102730 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e161af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e161af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45616/0 (socket says 172.21.15.29:45616) 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e161af640 1 -- 172.21.15.29:0/4051089778 learned_addr learned my addr 172.21.15.29:0/4051089778 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e161af640 1 -- 172.21.15.29:0/4051089778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e10197580 con 0x7f2e10102730 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e161af640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10197040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e08030b00 tx=0x7f2e08030b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:41.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e08040070 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2e080318b0 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e10197810 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.347+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e08003de0 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.348+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e10197c70 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.348+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2e08039040 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.348+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e10069f90 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.349+0000 7f2e0f7fe640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2df8039300 0x7f2df803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.349+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2e0806d7d0 con 0x7f2e10102730 2024-09-19T06:59:41.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.349+0000 7f2e159ae640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2df8039300 0x7f2df803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.349+0000 7f2e159ae640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2df8039300 0x7f2df803b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2e040098c0 tx=0x7f2e04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:41.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.353+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e08041cb0 con 0x7f2e10102730 2024-09-19T06:59:41.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.533+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2e101983a0 con 0x7f2e10102730 2024-09-19T06:59:41.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.728+0000 7f2e0f7fe640 1 -- 172.21.15.29:0/4051089778 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f2e08031b60 con 0x7f2e10102730 2024-09-19T06:59:41.729 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-09-19T06:59:41.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2df8039300 msgr2=0x7f2df803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:41.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2df8039300 0x7f2df803b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2e040098c0 tx=0x7f2e04006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 msgr2=0x7f2e10197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10197040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e08030b00 tx=0x7f2e08030b30 comp rx=0 tx=0).stop 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 shutdown_connections 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2df8039300 0x7f2df803b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 --2- 172.21.15.29:0/4051089778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e10102730 0x7f2e10197040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 >> 172.21.15.29:0/4051089778 conn(0x7f2e10077310 msgr2=0x7f2e101034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 shutdown_connections 2024-09-19T06:59:41.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T06:59:41.730+0000 7f2e18413640 1 -- 172.21.15.29:0/4051089778 wait complete. 2024-09-19T06:59:42.044 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:41 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4051089778' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:59:42.354 INFO:tasks.cephadm:Adding mon.a on smithi029 2024-09-19T06:59:42.355 INFO:tasks.cephadm:Adding mon.b on smithi046 2024-09-19T06:59:42.355 INFO:tasks.cephadm:Adding mon.c on smithi078 2024-09-19T06:59:42.355 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c' 2024-09-19T06:59:42.596 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:59:42.641 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:59:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4051089778' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:59:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:59:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:43.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:43.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:43.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:59:43.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:43.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:59:43.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:42 smithi029 ceph-mon[31255]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-19T06:59:43.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 -- 172.21.15.78:0/2280727349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 msgr2=0x7f00e8100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:43.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 --2- 172.21.15.78:0/2280727349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009880 tx=0x7f00d802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:43.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 -- 172.21.15.78:0/2280727349 shutdown_connections 2024-09-19T06:59:43.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 --2- 172.21.15.78:0/2280727349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:43.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 -- 172.21.15.78:0/2280727349 >> 172.21.15.78:0/2280727349 conn(0x7f00e80fbcd0 msgr2=0x7f00e80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:43.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 -- 172.21.15.78:0/2280727349 shutdown_connections 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.129+0000 7f00ee845640 1 -- 172.21.15.78:0/2280727349 wait complete. 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00ee845640 1 Processor -- start 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00ee845640 1 -- start start 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00ee845640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00ee845640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f00e81064a0 con 0x7f00e8100540 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.78:60950/0 (socket says 172.21.15.78:60950) 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.130+0000 7f00e7fff640 1 -- 172.21.15.78:0/2342758082 learned_addr learned my addr 172.21.15.78:0/2342758082 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00e7fff640 1 -- 172.21.15.78:0/2342758082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e8197200 con 0x7f00e8100540 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00e7fff640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8196cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009230 tx=0x7f00d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d803f070 con 0x7f00e8100540 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f00d8003aa0 con 0x7f00e8100540 2024-09-19T06:59:43.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e8197490 con 0x7f00e8100540 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00d8035030 con 0x7f00e8100540 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.131+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e819a180 con 0x7f00e8100540 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.132+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f00d8042070 con 0x7f00e8100540 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.132+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e8106c20 con 0x7f00e8100540 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.132+0000 7f00e57fa640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f00d00392a0 0x7f00d003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.132+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f00d806d230 con 0x7f00e8100540 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.133+0000 7f00e77fe640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f00d00392a0 0x7f00d003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.133+0000 7f00e77fe640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f00d00392a0 0x7f00d003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0098c0 tx=0x7f00dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:43.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.137+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f00d802f300 con 0x7f00e8100540 2024-09-19T06:59:43.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.325+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c", "target": ["mon-mgr", ""]}) -- 0x7f00e802d8e0 con 0x7f00d00392a0 2024-09-19T06:59:43.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.332+0000 7f00e57fa640 1 -- 172.21.15.78:0/2342758082 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f00e802d8e0 con 0x7f00d00392a0 2024-09-19T06:59:43.333 INFO:teuthology.orchestra.run.smithi078.stdout:Scheduled mon update... 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f00d00392a0 msgr2=0x7f00d003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f00d00392a0 0x7f00d003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0098c0 tx=0x7f00dc006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 msgr2=0x7f00e8196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8196cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009230 tx=0x7f00d80048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 shutdown_connections 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f00d00392a0 0x7f00d003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:43.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 --2- 172.21.15.78:0/2342758082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00e8100540 0x7f00e8196cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:43.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 >> 172.21.15.78:0/2342758082 conn(0x7f00e80fbcd0 msgr2=0x7f00e8069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:43.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 shutdown_connections 2024-09-19T06:59:43.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:43.334+0000 7f00ee845640 1 -- 172.21.15.78:0/2342758082 wait complete. 2024-09-19T06:59:44.075 DEBUG:teuthology.orchestra.run.smithi046:mon.b> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T06:59:44.078 DEBUG:teuthology.orchestra.run.smithi078:mon.c> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T06:59:44.080 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:59:44.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:59:44.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:59:44.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: Saving service mon spec with placement smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c;count:3 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:44 smithi029 ceph-mon[31255]: Deploying daemon mon.c on smithi078 2024-09-19T06:59:45.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:45 smithi029 ceph-mon[31255]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:45.939 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 -- 172.21.15.78:0/25569712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 msgr2=0x7fdbf0102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 --2- 172.21.15.78:0/25569712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0102c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009880 tx=0x7fdbe002a670 comp rx=0 tx=0).stop 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 -- 172.21.15.78:0/25569712 shutdown_connections 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 --2- 172.21.15.78:0/25569712 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0102c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 -- 172.21.15.78:0/25569712 >> 172.21.15.78:0/25569712 conn(0x7fdbf00fc290 msgr2=0x7fdbf00fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 -- 172.21.15.78:0/25569712 shutdown_connections 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.507+0000 7fdbf5c98640 1 -- 172.21.15.78:0/25569712 wait complete. 2024-09-19T06:59:46.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.508+0000 7fdbf5c98640 1 Processor -- start 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.508+0000 7fdbf5c98640 1 -- start start 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.508+0000 7fdbf5c98640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.508+0000 7fdbf5c98640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf010bc90 con 0x7fdbf0102870 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbef7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbef7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.78:57782/0 (socket says 172.21.15.78:57782) 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbef7fe640 1 -- 172.21.15.78:0/4167325757 learned_addr learned my addr 172.21.15.78:0/4167325757 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbef7fe640 1 -- 172.21.15.78:0/4167325757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf0197750 con 0x7fdbf0102870 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbef7fe640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0197210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009230 tx=0x7fdbe00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe003f070 con 0x7fdbf0102870 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbe0004d10 con 0x7fdbf0102870 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf01979e0 con 0x7fdbf0102870 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbe0035030 con 0x7fdbf0102870 2024-09-19T06:59:46.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.509+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf0197e40 con 0x7fdbf0102870 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.510+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fdbe0042070 con 0x7fdbf0102870 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.510+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf006ad10 con 0x7fdbf0102870 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.510+0000 7fdbecff9640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdbd80392a0 0x7fdbd803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.510+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdbe006d080 con 0x7fdbf0102870 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.511+0000 7fdbeeffd640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdbd80392a0 0x7fdbd803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.511+0000 7fdbeeffd640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdbd80392a0 0x7fdbd803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40098c0 tx=0x7fdbe4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:46.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.515+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbe0042360 con 0x7fdbf0102870 2024-09-19T06:59:46.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.761+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fdbf0198570 con 0x7fdbf0102870 2024-09-19T06:59:46.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.762+0000 7fdbecff9640 1 -- 172.21.15.78:0/4167325757 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fdbe002fdc0 con 0x7fdbf0102870 2024-09-19T06:59:46.763 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:59:46.764 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":1,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T06:58:14.453628Z","created":"2024-09-19T06:58:14.453628Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:59:46.764 INFO:teuthology.orchestra.run.smithi078.stderr:dumped monmap epoch 1 2024-09-19T06:59:46.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdbd80392a0 msgr2=0x7fdbd803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:46.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdbd80392a0 0x7fdbd803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40098c0 tx=0x7fdbe4006db0 comp rx=0 tx=0).stop 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 msgr2=0x7fdbf0197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0197210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009230 tx=0x7fdbe00048f0 comp rx=0 tx=0).stop 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 shutdown_connections 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdbd80392a0 0x7fdbd803b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 --2- 172.21.15.78:0/4167325757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf0102870 0x7fdbf0197210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 >> 172.21.15.78:0/4167325757 conn(0x7fdbf00fc290 msgr2=0x7fdbf0105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 shutdown_connections 2024-09-19T06:59:46.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:46.764+0000 7fdbf5c98640 1 -- 172.21.15.78:0/4167325757 wait complete. 2024-09-19T06:59:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:47 smithi029 ceph-mon[31255]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:47 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/4167325757' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:59:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 podman[34534]: 2024-09-19 06:59:47.877122117 +0000 UTC m=+0.346249931 container start 12de75059fc143432e584a999f3337851bea24d8ec349963781bf7d3e85c7a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:59:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:59:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:59:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pidfile_write: ignore empty --pid-file 2024-09-19T06:59:48.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: load: jerasure load: lrc 2024-09-19T06:59:48.415 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Git sha 0 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: DB SUMMARY 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: DB Session ID: 3AVKPBXQVUE6A0EKTEOJ 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:59:48.416 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:59:48.417 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.env: 0x5569689f5940 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.info_log: 0x55696aa0d6e0 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.statistics: (nil) 2024-09-19T06:59:48.418 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.use_fsync: 0 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:59:48.419 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.db_log_dir: 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.wal_dir: 2024-09-19T06:59:48.420 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:59:48.421 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:59:48.421 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:59:48.421 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:59:48.421 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:59:48.422 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:59:48.425 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:59:48.425 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:59:48.426 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:59:48.426 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:59:48.426 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.write_buffer_manager: 0x55696aa1cdc0 2024-09-19T06:59:48.427 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:59:48.427 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:59:48.427 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:59:48.427 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:59:48.427 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:59:48.427 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.unordered_write: 0 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:59:48.428 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.row_cache: None 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.wal_filter: None 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.wal_compression: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:59:48.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:59:48.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:59:48.431 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_open_files: -1 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Compression algorithms supported: 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kZSTD supported: 0 2024-09-19T06:59:48.432 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:59:48.433 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.merge_operator: 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_filter: None 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55696aa0d320) 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:59:48.434 INFO:journalctl@ceph.mon.c.smithi078.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: index_type: 0 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: data_block_index_type: 0 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: index_shortening: 1 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: checksum: 4 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: no_block_cache: 0 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_cache: 0x55696aa011f0 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:59:48.435 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_cache_options: 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: capacity : 536870912 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: num_shard_bits : 4 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: strict_capacity_limit : 0 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_cache_compressed: (nil) 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: persistent_cache: (nil) 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_size: 4096 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_size_deviation: 10 2024-09-19T06:59:48.436 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_restart_interval: 16 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: index_block_restart_interval: 1 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: metadata_block_size: 4096 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: partition_filters: 0 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: use_delta_encoding: 1 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: filter_policy: bloomfilter 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: whole_key_filtering: 1 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: verify_compression: 0 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: format_version: 5 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: enable_index_compression: 1 2024-09-19T06:59:48.437 INFO:journalctl@ceph.mon.c.smithi078.stdout: block_align: 0 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout: max_auto_readahead_size: 262144 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout: prepopulate_block_cache: 0 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression: NoCompression 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:59:48.438 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:59:48.439 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.num_levels: 7 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:59:48.440 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:59:48.441 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:59:48.442 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:59:48.443 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:59:48.444 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:59:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.ttl: 2592000 2024-09-19T06:59:48.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:59:48.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: aa05db78-cc53-4fe1-bfc1-0c0179e231bb 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729187904980, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T06:59:48.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729187905474, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726729187, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "aa05db78-cc53-4fe1-bfc1-0c0179e231bb", "db_session_id": "3AVKPBXQVUE6A0EKTEOJ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729187905570, "job": 1, "event": "recovery_finished"} 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55696aa2ee00 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: DB pointer 0x55696ab2a000 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout: ** DB Stats ** 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:59:48.449 INFO:journalctl@ceph.mon.c.smithi078.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:59:48.450 INFO:journalctl@ceph.mon.c.smithi078.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:59:48.451 INFO:journalctl@ceph.mon.c.smithi078.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:59:48.451 INFO:journalctl@ceph.mon.c.smithi078.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:59:48.451 INFO:journalctl@ceph.mon.c.smithi078.stdout: 2024-09-19T06:59:48.451 INFO:journalctl@ceph.mon.c.smithi078.stdout: ** Compaction Stats [default] ** 2024-09-19T06:59:48.451 INFO:journalctl@ceph.mon.c.smithi078.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:59:48.451 INFO:journalctl@ceph.mon.c.smithi078.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:59:48.452 INFO:journalctl@ceph.mon.c.smithi078.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T06:59:48.453 INFO:journalctl@ceph.mon.c.smithi078.stdout: 2024-09-19T06:59:48.453 INFO:journalctl@ceph.mon.c.smithi078.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:59:48.453 INFO:journalctl@ceph.mon.c.smithi078.stdout: 2024-09-19T06:59:48.453 INFO:journalctl@ceph.mon.c.smithi078.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:59:48.454 INFO:journalctl@ceph.mon.c.smithi078.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:59:48.454 INFO:journalctl@ceph.mon.c.smithi078.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:59:48.454 INFO:journalctl@ceph.mon.c.smithi078.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:59:48.454 INFO:journalctl@ceph.mon.c.smithi078.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:59:48.454 INFO:journalctl@ceph.mon.c.smithi078.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:59:48.454 INFO:journalctl@ceph.mon.c.smithi078.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:59:48.455 INFO:journalctl@ceph.mon.c.smithi078.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:59:48.455 INFO:journalctl@ceph.mon.c.smithi078.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:59:48.455 INFO:journalctl@ceph.mon.c.smithi078.stdout: Block cache BinnedLRUCache@0x55696aa011f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T06:59:48.455 INFO:journalctl@ceph.mon.c.smithi078.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:59:48.455 INFO:journalctl@ceph.mon.c.smithi078.stdout: 2024-09-19T06:59:48.455 INFO:journalctl@ceph.mon.c.smithi078.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:59:48.456 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T06:59:48.456 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: using public_addr v2:172.21.15.78:0/0 -> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-19T06:59:48.456 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: starting mon.c rank -1 at public addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] at bind addrs [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:48.456 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(???) e0 preinit fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:48.456 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T06:59:48.457 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T06:59:48.457 INFO:journalctl@ceph.mon.c.smithi078.stdout: e1 2024-09-19T06:59:48.457 INFO:journalctl@ceph.mon.c.smithi078.stdout: btime 2024-09-19T06:58:24:064353+0000 2024-09-19T06:59:48.457 INFO:journalctl@ceph.mon.c.smithi078.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:59:48.457 INFO:journalctl@ceph.mon.c.smithi078.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout: legacy client fscid: -1 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout: 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout: No filesystems configured 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T06:59:48.458 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Updating smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Added host smithi078 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:59:48.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4051089778' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4051089778' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi078", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Updating smithi078:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Saving service mon spec with placement smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c;count:3 2024-09-19T06:59:48.461 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: Deploying daemon mon.c on smithi078 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/4167325757' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 ceph-mon[34556]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T06:59:48.462 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 bash[34534]: 12de75059fc143432e584a999f3337851bea24d8ec349963781bf7d3e85c7a82 2024-09-19T06:59:48.463 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:47 smithi078 systemd[1]: Started Ceph mon.c for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T06:59:48.722 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: mon.a calling monitor election 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: mon.c calling monitor election 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: monmap epoch 2 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: last_changed 2024-09-19T06:59:47.929822+0000 2024-09-19T06:59:53.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: min_mon_release 19 (squid) 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: election_strategy: 1 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: 1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.c 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: fsmap 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: mgrmap e13: x(active, since 39s) 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: overall HEALTH_OK 2024-09-19T06:59:53.377 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:53.378 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:53.378 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:53.378 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:59:53.378 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:53.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:53.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: mon.a calling monitor election 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: mon.c calling monitor election 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: monmap epoch 2 2024-09-19T06:59:53.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: last_changed 2024-09-19T06:59:47.929822+0000 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: min_mon_release 19 (squid) 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: election_strategy: 1 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: 1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.c 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: fsmap 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: mgrmap e13: x(active, since 39s) 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: overall HEALTH_OK 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:53.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:53.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T06:59:53.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:59:53.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:59:53.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 -- 172.21.15.78:0/1657545799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 msgr2=0x7f0b540059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:53.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/1657545799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b540059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c06a240 tx=0x7f0b5c02bfe0 comp rx=0 tx=0).stop 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 -- 172.21.15.78:0/1657545799 shutdown_connections 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/1657545799 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b540059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 -- 172.21.15.78:0/1657545799 >> 172.21.15.78:0/1657545799 conn(0x7f0b6c0fc280 msgr2=0x7f0b6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 -- 172.21.15.78:0/1657545799 shutdown_connections 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.560+0000 7f0b71b0f640 1 -- 172.21.15.78:0/1657545799 wait complete. 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.561+0000 7f0b71b0f640 1 Processor -- start 2024-09-19T06:59:53.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.561+0000 7f0b71b0f640 1 -- start start 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b71b0f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b6c1004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b71b0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b71b0f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c109650 con 0x7f0b54003530 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b71b0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1094d0 con 0x7f0b6c1009e0 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b6c1004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35982/0 (socket says 172.21.15.78:35982) 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 -- 172.21.15.78:0/3759843287 learned_addr learned my addr 172.21.15.78:0/3759843287 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b6c1004a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.78:42550/0 (socket says 172.21.15.78:42550) 2024-09-19T06:59:53.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 -- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 msgr2=0x7f0b6c100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 -- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 msgr2=0x7f0b6c100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6affd640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6b7fe640 1 -- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 msgr2=0x7f0b6c100e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.562+0000 7f0b6b7fe640 1 -- 172.21.15.78:0/3759843287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c102390 con 0x7f0b54003530 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.563+0000 7f0b6b7fe640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b6c1004a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c036040 tx=0x7f0b5c004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.563+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0b5c0346b0 con 0x7f0b54003530 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.563+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b5c034d00 con 0x7f0b54003530 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.563+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c1a34b0 con 0x7f0b54003530 2024-09-19T06:59:53.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.563+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0b5c03c3f0 con 0x7f0b54003530 2024-09-19T06:59:53.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.563+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c1a3a40 con 0x7f0b54003530 2024-09-19T06:59:53.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.564+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0b5c043070 con 0x7f0b54003530 2024-09-19T06:59:53.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.564+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c06a4f0 con 0x7f0b54003530 2024-09-19T06:59:53.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.564+0000 7f0b68ff9640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0b58039090 0x7f0b5803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:53.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.564+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b5c06dd50 con 0x7f0b54003530 2024-09-19T06:59:53.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.565+0000 7f0b6affd640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0b58039090 0x7f0b5803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:53.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.565+0000 7f0b6affd640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0b58039090 0x7f0b5803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009100 tx=0x7f0b60008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.570+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b5c03b350 con 0x7f0b54003530 2024-09-19T06:59:53.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.802+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0b6c1a3cf0 con 0x7f0b54003530 2024-09-19T06:59:53.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.803+0000 7f0b68ff9640 1 -- 172.21.15.78:0/3759843287 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f0b5c040210 con 0x7f0b54003530 2024-09-19T06:59:53.804 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:59:53.805 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T06:59:47.929822Z","created":"2024-09-19T06:58:14.453628Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:59:53.805 INFO:teuthology.orchestra.run.smithi078.stderr:dumped monmap epoch 2 2024-09-19T06:59:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0b58039090 msgr2=0x7f0b5803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:53.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0b58039090 0x7f0b5803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009100 tx=0x7f0b60008040 comp rx=0 tx=0).stop 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 msgr2=0x7f0b6c1004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b6c1004a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c036040 tx=0x7f0b5c004a00 comp rx=0 tx=0).stop 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 shutdown_connections 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0b58039090 0x7f0b5803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c1009e0 0x7f0b6c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 --2- 172.21.15.78:0/3759843287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0b54003530 0x7f0b6c1004a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 >> 172.21.15.78:0/3759843287 conn(0x7f0b6c0fc280 msgr2=0x7f0b6c18fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 shutdown_connections 2024-09-19T06:59:53.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:53.805+0000 7f0b71b0f640 1 -- 172.21.15.78:0/3759843287 wait complete. 2024-09-19T06:59:54.130 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:54 smithi078 ceph-mon[34556]: Deploying daemon mon.b on smithi046 2024-09-19T06:59:54.130 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:54 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/3759843287' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:59:54.130 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:54 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:54.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:54 smithi029 ceph-mon[31255]: Deploying daemon mon.b on smithi046 2024-09-19T06:59:54.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:54 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/3759843287' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:59:54.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:54 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:59:55.275 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 06:59:55 smithi029 ceph-mon[31255]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:55.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 06:59:55 smithi078 ceph-mon[34556]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:59:55.467 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:59:55.467 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:59:55.728 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 -- 172.21.15.78:0/2636574733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 msgr2=0x7fee60107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 --2- 172.21.15.78:0/2636574733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60107a90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee50009880 tx=0x7fee5002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 -- 172.21.15.78:0/2636574733 shutdown_connections 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 --2- 172.21.15.78:0/2636574733 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60107a90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 -- 172.21.15.78:0/2636574733 >> 172.21.15.78:0/2636574733 conn(0x7fee600fd390 msgr2=0x7fee600ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 -- 172.21.15.78:0/2636574733 shutdown_connections 2024-09-19T06:59:56.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.178+0000 7fee6565c640 1 -- 172.21.15.78:0/2636574733 wait complete. 2024-09-19T06:59:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee6565c640 1 Processor -- start 2024-09-19T06:59:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee6565c640 1 -- start start 2024-09-19T06:59:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee6565c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee6565c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 0x7fee6019bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee6565c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010bc20 con 0x7fee601076b0 2024-09-19T06:59:56.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee6565c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee6010baa0 con 0x7fee601977c0 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee5effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee5effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.78:42576/0 (socket says 172.21.15.78:42576) 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee5effd640 1 -- 172.21.15.78:0/2380567363 learned_addr learned my addr 172.21.15.78:0/2380567363 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.179+0000 7fee567fc640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 0x7fee6019bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee567fc640 1 -- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 msgr2=0x7fee6019bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee567fc640 1 -- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 msgr2=0x7fee6019bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee567fc640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 0x7fee6019bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee567fc640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 0x7fee6019bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5effd640 1 -- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 msgr2=0x7fee6019bb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:59:56.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5effd640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 0x7fee6019bb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5effd640 1 -- 172.21.15.78:0/2380567363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee60197de0 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5effd640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60197280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee50000c00 tx=0x7fee50004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fee50035030 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6019c090 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fee50005360 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fee500318c0 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.180+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6019c5d0 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.181+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fee50042070 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.181+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee60102df0 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.181+0000 7fee5cff9640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fee4c039040 0x7fee4c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.181+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fee5006d0e0 con 0x7fee601076b0 2024-09-19T06:59:56.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.181+0000 7fee567fc640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fee4c039040 0x7fee4c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:56.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.182+0000 7fee567fc640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fee4c039040 0x7fee4c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee48006fd0 tx=0x7fee48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:56.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.187+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee5004a260 con 0x7fee601076b0 2024-09-19T06:59:56.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.415+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fee6019c940 con 0x7fee601076b0 2024-09-19T06:59:56.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.415+0000 7fee5cff9640 1 -- 172.21.15.78:0/2380567363 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fee500035f0 con 0x7fee601076b0 2024-09-19T06:59:56.416 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T06:59:56.417 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T06:59:47.929822Z","created":"2024-09-19T06:58:14.453628Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:59:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:dumped monmap epoch 2 2024-09-19T06:59:56.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fee4c039040 msgr2=0x7fee4c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:56.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fee4c039040 0x7fee4c03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee48006fd0 tx=0x7fee48008040 comp rx=0 tx=0).stop 2024-09-19T06:59:56.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 msgr2=0x7fee60197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60197280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee50000c00 tx=0x7fee50004f10 comp rx=0 tx=0).stop 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 shutdown_connections 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fee4c039040 0x7fee4c03b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee601977c0 0x7fee6019bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 --2- 172.21.15.78:0/2380567363 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fee601076b0 0x7fee60197280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 >> 172.21.15.78:0/2380567363 conn(0x7fee600fd390 msgr2=0x7fee600fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 shutdown_connections 2024-09-19T06:59:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T06:59:56.417+0000 7fee6565c640 1 -- 172.21.15.78:0/2380567363 wait complete. 2024-09-19T06:59:56.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 06:59:56 smithi046 systemd[1]: Started Ceph mon.b for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T06:59:58.030 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:59:58.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:59:58.278 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:00:01.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 -- 172.21.15.78:0/3689435508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe088003530 msgr2=0x7fe0880059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:01.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/3689435508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe088003530 0x7fe0880059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0102af0 tx=0x7fe09002bc80 comp rx=0 tx=0).stop 2024-09-19T07:00:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 -- 172.21.15.78:0/3689435508 shutdown_connections 2024-09-19T07:00:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/3689435508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe088003530 0x7fe0880059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 -- 172.21.15.78:0/3689435508 >> 172.21.15.78:0/3689435508 conn(0x7fe0a00fd320 msgr2=0x7fe0a00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 -- 172.21.15.78:0/3689435508 shutdown_connections 2024-09-19T07:00:01.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.686+0000 7fe0a52fb640 1 -- 172.21.15.78:0/3689435508 wait complete. 2024-09-19T07:00:01.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.687+0000 7fe0a52fb640 1 Processor -- start 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.687+0000 7fe0a52fb640 1 -- start start 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe0a52fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe0a52fb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a01978c0 0x7fe0a019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe0a52fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 0x7fe0a019c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe0a52fb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0109630 con 0x7fe0a01978c0 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe0a52fb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a01094b0 con 0x7fe0a019c190 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe0a52fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a01097b0 con 0x7fe088003530 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36002/0 (socket says 172.21.15.78:36002) 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 -- 172.21.15.78:0/1396832747 learned_addr learned my addr 172.21.15.78:0/1396832747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09e7fc640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a01978c0 0x7fe0a019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 msgr2=0x7fe0a0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 msgr2=0x7fe0a0197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09f7fe640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 0x7fe0a019c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09effd640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09f7fe640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 msgr2=0x7fe0a019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09f7fe640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 msgr2=0x7fe0a019c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09f7fe640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 0x7fe0a019c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09f7fe640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 0x7fe0a019c640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09e7fc640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 msgr2=0x7fe0a0197380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09e7fc640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09e7fc640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 msgr2=0x7fe0a019c640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09e7fc640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 0x7fe0a019c640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.688+0000 7fe09e7fc640 1 -- 172.21.15.78:0/1396832747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a01a3f00 con 0x7fe0a01978c0 2024-09-19T07:00:01.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.689+0000 7fe09e7fc640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a01978c0 0x7fe0a019bc50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b450 tx=0x7fe09400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.689+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094004230 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.689+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0940043d0 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.689+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094003be0 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.689+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a01a4130 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.689+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a01a4640 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.690+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe09400f050 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.690+0000 7fe087fff640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe08c039730 0x7fe08c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.690+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe09404d090 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.690+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a010a760 con 0x7fe0a01978c0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.691+0000 7fe09effd640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe08c039730 0x7fe08c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.691+0000 7fe09effd640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe08c039730 0x7fe08c03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe090009530 tx=0x7fe090009480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:01.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.696+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe09400d040 con 0x7fe0a01978c0 2024-09-19T07:00:01.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:01.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:00:01.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: mon.a calling monitor election 2024-09-19T07:00:01.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: mon.c calling monitor election 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: mon.b calling monitor election 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: monmap epoch 3 2024-09-19T07:00:01.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: last_changed 2024-09-19T06:59:56.642259+0000 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: min_mon_release 19 (squid) 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: election_strategy: 1 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: 1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.c 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: 2: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.b 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: fsmap 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: mgrmap e13: x(active, since 47s) 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: overall HEALTH_OK 2024-09-19T07:00:01.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.949 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.949 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.949 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.944+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe0a0190d90 con 0x7fe0a01978c0 2024-09-19T07:00:01.950 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T07:00:01.950 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","modified":"2024-09-19T06:59:56.642259Z","created":"2024-09-19T06:58:14.453628Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:3300","nonce":0},{"type":"v1","addr":"172.21.15.29:6789","nonce":0}]},"addr":"172.21.15.29:6789/0","public_addr":"172.21.15.29:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-19T07:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.945+0000 7fe087fff640 1 -- 172.21.15.78:0/1396832747 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1277 (secure 0 0 0) 0x7fe094003e10 con 0x7fe0a01978c0 2024-09-19T07:00:01.950 INFO:teuthology.orchestra.run.smithi078.stderr:dumped monmap epoch 3 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe08c039730 msgr2=0x7fe08c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe08c039730 0x7fe08c03bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe090009530 tx=0x7fe090009480 comp rx=0 tx=0).stop 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a01978c0 msgr2=0x7fe0a019bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a01978c0 0x7fe0a019bc50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b450 tx=0x7fe09400b910 comp rx=0 tx=0).stop 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 shutdown_connections 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe0a019c190 0x7fe0a019c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a01978c0 0x7fe0a019bc50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe08c039730 0x7fe08c03bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 --2- 172.21.15.78:0/1396832747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe088003530 0x7fe0a0197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 >> 172.21.15.78:0/1396832747 conn(0x7fe0a00fd320 msgr2=0x7fe0a0106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 shutdown_connections 2024-09-19T07:00:01.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:01.947+0000 7fe0a52fb640 1 -- 172.21.15.78:0/1396832747 wait complete. 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: mon.a calling monitor election 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: mon.c calling monitor election 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:01.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: mon.b calling monitor election 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: monmap epoch 3 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: last_changed 2024-09-19T06:59:56.642259+0000 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: min_mon_release 19 (squid) 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: election_strategy: 1 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T07:00:01.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: 1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.c 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: 2: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.b 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: fsmap 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: mgrmap e13: x(active, since 47s) 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: overall HEALTH_OK 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:01.978 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:02.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:02.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:00:02.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: mon.a calling monitor election 2024-09-19T07:00:02.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: mon.c calling monitor election 2024-09-19T07:00:02.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: mon.b calling monitor election 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: monmap epoch 3 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:00:02.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: last_changed 2024-09-19T06:59:56.642259+0000 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: created 2024-09-19T06:58:14.453628+0000 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: min_mon_release 19 (squid) 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: election_strategy: 1 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: 0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: 1: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.c 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: 2: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.b 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: fsmap 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: mgrmap e13: x(active, since 47s) 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: overall HEALTH_OK 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:02.127 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:02.531 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T07:00:02.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T07:00:02.801 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:00:02.820 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:02.820 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:02 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/1396832747' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:00:02.820 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:02.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:02 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/1396832747' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:00:02.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:02 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/1396832747' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:00:02.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:00:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.366+0000 7fcec7f06640 1 -- 172.21.15.29:0/801186078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01027d0 msgr2=0x7fcec0102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.366+0000 7fcec7f06640 1 --2- 172.21.15.29:0/801186078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01027d0 0x7fcec0102bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009810 tx=0x7fcebc02a540 comp rx=0 tx=0).stop 2024-09-19T07:00:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.366+0000 7fcec7f06640 1 -- 172.21.15.29:0/801186078 shutdown_connections 2024-09-19T07:00:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.366+0000 7fcec7f06640 1 --2- 172.21.15.29:0/801186078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01027d0 0x7fcec0102bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.366+0000 7fcec7f06640 1 -- 172.21.15.29:0/801186078 >> 172.21.15.29:0/801186078 conn(0x7fcec0077310 msgr2=0x7fcec00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:03.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.367+0000 7fcec7f06640 1 -- 172.21.15.29:0/801186078 shutdown_connections 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.367+0000 7fcec7f06640 1 -- 172.21.15.29:0/801186078 wait complete. 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.367+0000 7fcec7f06640 1 Processor -- start 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.367+0000 7fcec7f06640 1 -- start start 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec7f06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec01027d0 0x7fcec0100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec7f06640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec0100970 0x7fcec0100dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec7f06640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 0x7fcec01a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec7f06640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcec010bae0 con 0x7fcec01a3500 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec7f06640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcec010b960 con 0x7fcec0100970 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec7f06640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcec010bc60 con 0x7fcec01027d0 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 0x7fcec01a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 0x7fcec01a58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44654/0 (socket says 172.21.15.29:44654) 2024-09-19T07:00:03.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 -- 172.21.15.29:0/3368781471 learned_addr learned my addr 172.21.15.29:0/3368781471 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec5ca2640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec01027d0 0x7fcec0100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec54a1640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec0100970 0x7fcec0100dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 -- 172.21.15.29:0/3368781471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec01027d0 msgr2=0x7fcec0100430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec01027d0 0x7fcec0100430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 -- 172.21.15.29:0/3368781471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec0100970 msgr2=0x7fcec0100dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec0100970 0x7fcec0100dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 -- 172.21.15.29:0/3368781471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec01a5fc0 con 0x7fcec01a3500 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fcec64a3640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 0x7fcec01a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fceb800ba50 tx=0x7fceb800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.368+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8019070 con 0x7fcec01a3500 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.369+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec01a62b0 con 0x7fcec01a3500 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.369+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fceb800cbe0 con 0x7fcec01a3500 2024-09-19T07:00:03.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.369+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb80075d0 con 0x7fcec01a3500 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.369+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01a67f0 con 0x7fcec01a3500 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.370+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec0069ef0 con 0x7fcec01a3500 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.370+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fceb801c070 con 0x7fcec01a3500 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.370+0000 7fceb6ffd640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fceac039730 0x7fceac03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.370+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fceb804be70 con 0x7fcec01a3500 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.370+0000 7fcec5ca2640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fceac039730 0x7fceac03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.371+0000 7fcec5ca2640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fceac039730 0x7fceac03bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcebc005e60 tx=0x7fcebc005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:03.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.375+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fceb8007d10 con 0x7fcec01a3500 2024-09-19T07:00:03.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.554+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fcec01a6ab0 con 0x7fcec01a3500 2024-09-19T07:00:03.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.555+0000 7fceb6ffd640 1 -- 172.21.15.29:0/3368781471 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7fceb80077d0 con 0x7fcec01a3500 2024-09-19T07:00:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:# minimal ceph.conf for 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:00:03.557 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-09-19T07:00:03.557 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:00:03.557 INFO:teuthology.orchestra.run.smithi029.stdout: mon_host = [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fceac039730 msgr2=0x7fceac03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fceac039730 0x7fceac03bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcebc005e60 tx=0x7fcebc005870 comp rx=0 tx=0).stop 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 msgr2=0x7fcec01a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 0x7fcec01a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fceb800ba50 tx=0x7fceb800bf10 comp rx=0 tx=0).stop 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 shutdown_connections 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcec01a3500 0x7fcec01a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec0100970 0x7fcec0100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fceac039730 0x7fceac03bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 --2- 172.21.15.29:0/3368781471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcec01027d0 0x7fcec0100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:03.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 >> 172.21.15.29:0/3368781471 conn(0x7fcec0077310 msgr2=0x7fcec0103550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:03.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 shutdown_connections 2024-09-19T07:00:03.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:03.557+0000 7fcec7f06640 1 -- 172.21.15.29:0/3368781471 wait complete. 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:03 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3368781471' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:03 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3368781471' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:04.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:03 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3368781471' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:04.263 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T07:00:04.264 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:00:04.264 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:00:04.293 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:00:04.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:04.359 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T07:00:04.359 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:00:04.388 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T07:00:04.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:04.455 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T07:00:04.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:00:04.485 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T07:00:04.485 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:00:04.551 INFO:tasks.cephadm:Adding mgr.x on smithi029 2024-09-19T07:00:04.551 INFO:tasks.cephadm:Adding mgr.y on smithi046 2024-09-19T07:00:04.551 INFO:tasks.cephadm:Adding mgr.z on smithi078 2024-09-19T07:00:04.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi029=x;smithi046=y;smithi078=z' 2024-09-19T07:00:04.828 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:00:04.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-19T07:00:04.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T07:00:04.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-19T07:00:04.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: Updating smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: Updating smithi029:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:04.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:04.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: Updating smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: Updating smithi029:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:04.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:04.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: Updating smithi029:/etc/ceph/ceph.conf 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: Updating smithi078:/etc/ceph/ceph.conf 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: Updating smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: Updating smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: Updating smithi029:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:04.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 -- 172.21.15.78:0/892111221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81581005f0 msgr2=0x7f81581009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 --2- 172.21.15.78:0/892111221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81581005f0 0x7f81581009f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8148009880 tx=0x7f814802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 -- 172.21.15.78:0/892111221 shutdown_connections 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 --2- 172.21.15.78:0/892111221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81581005f0 0x7f81581009f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 -- 172.21.15.78:0/892111221 >> 172.21.15.78:0/892111221 conn(0x7f81580fbda0 msgr2=0x7f81580fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 -- 172.21.15.78:0/892111221 shutdown_connections 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 -- 172.21.15.78:0/892111221 wait complete. 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 Processor -- start 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.256+0000 7f815e7a2640 1 -- start start 2024-09-19T07:00:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815e7a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81581005f0 0x7f815806af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815e7a2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f815819c090 0x7f815819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815e7a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 0x7f81581a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815e7a2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f81581065b0 con 0x7f815819c090 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815e7a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8158106430 con 0x7f81581005f0 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815e7a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8158106730 con 0x7f815819e9c0 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 0x7f81581a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 0x7f81581a0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45136/0 (socket says 172.21.15.78:45136) 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 -- 172.21.15.78:0/46076992 learned_addr learned my addr 172.21.15.78:0/46076992 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f814ffff640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f815819c090 0x7f815819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f8157fff640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81581005f0 0x7f815806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 -- 172.21.15.78:0/46076992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81581005f0 msgr2=0x7f815806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81581005f0 0x7f815806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 -- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f815819c090 msgr2=0x7f815819e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f815819c090 0x7f815819e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 -- 172.21.15.78:0/46076992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81581a15a0 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.257+0000 7f815cd3f640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 0x7f81581a0db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f815000ba50 tx=0x7f815000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.258+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150019070 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.258+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f815000cbe0 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.258+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81581a1830 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.258+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81500075d0 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.258+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81581a1df0 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.258+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f815001c070 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.259+0000 7f8155ffb640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8144039760 0x7f814403bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.259+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f815004cc90 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.259+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815818f370 con 0x7f815819e9c0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.259+0000 7f8157fff640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8144039760 0x7f814403bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.259+0000 7f8157fff640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8144039760 0x7f814403bc20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f814802ab40 tx=0x7f814802aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:05.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.264+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f815000e0a0 con 0x7f815819e9c0 2024-09-19T07:00:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.443+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi046=y;smithi078=z", "target": ["mon-mgr", ""]}) -- 0x7f81580626c0 con 0x7f8144039760 2024-09-19T07:00:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.448+0000 7f8155ffb640 1 -- 172.21.15.78:0/46076992 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f81580626c0 con 0x7f8144039760 2024-09-19T07:00:05.449 INFO:teuthology.orchestra.run.smithi078.stdout:Scheduled mgr update... 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8144039760 msgr2=0x7f814403bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8144039760 0x7f814403bc20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f814802ab40 tx=0x7f814802aad0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 msgr2=0x7f81581a0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 0x7f81581a0db0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f815000ba50 tx=0x7f815000bf10 comp rx=0 tx=0).stop 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 shutdown_connections 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8144039760 0x7f814403bc20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f815819e9c0 0x7f81581a0db0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f815819c090 0x7f815819e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 --2- 172.21.15.78:0/46076992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81581005f0 0x7f815806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.450+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 >> 172.21.15.78:0/46076992 conn(0x7f81580fbda0 msgr2=0x7f81580fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.451+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 shutdown_connections 2024-09-19T07:00:05.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:00:05.451+0000 7f815e7a2640 1 -- 172.21.15.78:0/46076992 wait complete. 2024-09-19T07:00:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:00:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: Reconfiguring daemon mon.a on smithi029 2024-09-19T07:00:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: Reconfiguring daemon mon.a on smithi029 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:06.120 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:06.121 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: Reconfiguring daemon mon.a on smithi029 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:06.147 DEBUG:teuthology.orchestra.run.smithi046:mgr.y> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T07:00:06.152 DEBUG:teuthology.orchestra.run.smithi078:mgr.z> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T07:00:06.155 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T07:00:06.155 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:00:06.155 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:00:06.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:00:06.176 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-09-19T07:00:06.236 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:00:06.236 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:06.236 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T07:00:06.236 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:06.237 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:06.237 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-19 06:59:25.021527999 +0000 2024-09-19T07:00:06.237 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-19 06:55:04.946824871 +0000 2024-09-19T07:00:06.237 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-19 06:55:04.946824871 +0000 2024-09-19T07:00:06.237 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-19 06:55:04.946824871 +0000 2024-09-19T07:00:06.237 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:00:06.306 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-19T07:00:06.307 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-19T07:00:06.307 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000134123 s, 3.8 MB/s 2024-09-19T07:00:06.308 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:00:06.367 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-19 06:59:25.059527376 +0000 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-19 06:55:05.270819665 +0000 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-19 06:55:05.270819665 +0000 2024-09-19T07:00:06.426 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-19 06:55:05.270819665 +0000 2024-09-19T07:00:06.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:00:06.492 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-19T07:00:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-19T07:00:06.496 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000107156 s, 4.8 MB/s 2024-09-19T07:00:06.497 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:00:06.556 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-09-19T07:00:06.613 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-19 06:59:25.096526771 +0000 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-19 06:55:05.583814636 +0000 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-19 06:55:05.583814636 +0000 2024-09-19T07:00:06.614 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-19 06:55:05.583814636 +0000 2024-09-19T07:00:06.614 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:00:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-19T07:00:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-19T07:00:06.680 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000117516 s, 4.4 MB/s 2024-09-19T07:00:06.682 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:00:06.739 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-09-19T07:00:06.797 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:00:06.797 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:06.797 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T07:00:06.798 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:06.798 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:06.798 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-19 06:59:25.132526182 +0000 2024-09-19T07:00:06.798 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-19 06:55:05.913809334 +0000 2024-09-19T07:00:06.798 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-19 06:55:05.913809334 +0000 2024-09-19T07:00:06.798 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-19 06:55:05.913809334 +0000 2024-09-19T07:00:06.798 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:00:06.863 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-19T07:00:06.863 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-19T07:00:06.863 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000104078 s, 4.9 MB/s 2024-09-19T07:00:06.865 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:00:06.922 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T07:00:06.922 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:00:06.940 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:00:06.941 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-09-19T07:00:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:06 smithi046 ceph-mon[34147]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:00:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:06 smithi046 ceph-mon[34147]: Reconfiguring daemon mon.b on smithi046 2024-09-19T07:00:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:06 smithi046 ceph-mon[34147]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi046=y;smithi078=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:06 smithi046 ceph-mon[34147]: Saving service mgr spec with placement smithi029=x;smithi046=y;smithi078=z;count:3 2024-09-19T07:00:06.991 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:00:06.991 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 06:59:56.093118242 +0000 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 06:54:57.241591444 +0000 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 06:54:57.241591444 +0000 2024-09-19T07:00:06.992 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 06:54:57.241591444 +0000 2024-09-19T07:00:06.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:00:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T07:00:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T07:00:07.058 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000120751 s, 4.2 MB/s 2024-09-19T07:00:07.060 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:00:07.117 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-09-19T07:00:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:06 smithi029 ceph-mon[31255]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:00:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:06 smithi029 ceph-mon[31255]: Reconfiguring daemon mon.b on smithi046 2024-09-19T07:00:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:06 smithi029 ceph-mon[31255]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi046=y;smithi078=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:06 smithi029 ceph-mon[31255]: Saving service mgr spec with placement smithi029=x;smithi046=y;smithi078=z;count:3 2024-09-19T07:00:07.158 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:06 smithi078 ceph-mon[34556]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:00:07.158 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:06 smithi078 ceph-mon[34556]: Reconfiguring daemon mon.b on smithi046 2024-09-19T07:00:07.158 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:06 smithi078 ceph-mon[34556]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi029=x;smithi046=y;smithi078=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:07.158 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:06 smithi078 ceph-mon[34556]: Saving service mgr spec with placement smithi029=x;smithi046=y;smithi078=z;count:3 2024-09-19T07:00:07.174 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:00:07.174 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:07.174 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T07:00:07.174 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:07.174 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:07.175 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 06:59:56.093118242 +0000 2024-09-19T07:00:07.175 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 06:54:57.568587799 +0000 2024-09-19T07:00:07.175 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 06:54:57.568587799 +0000 2024-09-19T07:00:07.175 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 06:54:57.568587799 +0000 2024-09-19T07:00:07.175 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:00:07.240 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T07:00:07.240 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T07:00:07.240 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000116279 s, 4.4 MB/s 2024-09-19T07:00:07.242 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:00:07.299 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 06:59:56.093118242 +0000 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 06:54:57.905584044 +0000 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 06:54:57.905584044 +0000 2024-09-19T07:00:07.356 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 06:54:57.905584044 +0000 2024-09-19T07:00:07.356 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:00:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T07:00:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T07:00:07.420 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000105927 s, 4.8 MB/s 2024-09-19T07:00:07.422 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:00:07.478 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-09-19T07:00:07.536 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:00:07.536 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:07.536 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T07:00:07.537 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:07.537 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:07.537 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 06:59:56.094118230 +0000 2024-09-19T07:00:07.537 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 06:54:58.225580478 +0000 2024-09-19T07:00:07.537 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 06:54:58.225580478 +0000 2024-09-19T07:00:07.537 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 06:54:58.225580478 +0000 2024-09-19T07:00:07.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:00:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T07:00:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T07:00:07.600 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000105398 s, 4.9 MB/s 2024-09-19T07:00:07.601 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:00:07.658 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-19T07:00:07.658 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:00:07.675 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:00:07.675 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-19T07:00:07.730 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-19 06:59:46.886383308 +0000 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-19 06:54:51.787552374 +0000 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-19 06:54:51.787552374 +0000 2024-09-19T07:00:07.731 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-19 06:54:51.787552374 +0000 2024-09-19T07:00:07.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:00:07.792 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:07 smithi078 ceph-mon[34556]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:07.793 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:07.793 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:07.793 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:07.793 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:07.793 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:07.795 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-19T07:00:07.795 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-19T07:00:07.795 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000284189 s, 1.8 MB/s 2024-09-19T07:00:07.797 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:00:07.853 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-19 06:59:46.886383308 +0000 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-19 06:54:52.128546811 +0000 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-19 06:54:52.128546811 +0000 2024-09-19T07:00:07.909 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-19 06:54:52.128546811 +0000 2024-09-19T07:00:07.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:00:07.972 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-19T07:00:07.972 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-19T07:00:07.972 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000275453 s, 1.9 MB/s 2024-09-19T07:00:07.973 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:00:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:07 smithi046 ceph-mon[34147]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:08.030 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-19T07:00:08.085 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-19 06:59:46.887383292 +0000 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-19 06:54:52.448541590 +0000 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-19 06:54:52.448541590 +0000 2024-09-19T07:00:08.086 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-19 06:54:52.448541590 +0000 2024-09-19T07:00:08.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:00:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:07 smithi029 ceph-mon[31255]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:00:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:00:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:08.150 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-19T07:00:08.150 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-19T07:00:08.150 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000208908 s, 2.5 MB/s 2024-09-19T07:00:08.152 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:00:08.208 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-19T07:00:08.264 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-19 06:59:46.887383292 +0000 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-19 06:54:52.776536239 +0000 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-19 06:54:52.776536239 +0000 2024-09-19T07:00:08.265 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-19 06:54:52.776536239 +0000 2024-09-19T07:00:08.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:00:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-19T07:00:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-19T07:00:08.329 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000178716 s, 2.9 MB/s 2024-09-19T07:00:08.330 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:00:08.386 INFO:tasks.cephadm:Deploying osd.0 on smithi029 with /dev/vg_nvme/lv_4... 2024-09-19T07:00:08.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:00:08.647 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: Reconfiguring daemon mon.c on smithi078 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:08.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:08.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:00:08.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:08.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:08.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: Reconfiguring daemon mon.c on smithi078 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:08.997 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:00:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: Reconfiguring daemon mon.c on smithi078 2024-09-19T07:00:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:09.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:09.759 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:09 smithi078 ceph-mon[34556]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:09.759 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:09 smithi078 ceph-mon[34556]: Deploying daemon mgr.z on smithi078 2024-09-19T07:00:10.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:09 smithi029 ceph-mon[31255]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:10.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:09 smithi029 ceph-mon[31255]: Deploying daemon mgr.z on smithi078 2024-09-19T07:00:10.134 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:09 smithi078 systemd[1]: Starting Ceph mgr.z for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:00:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:09 smithi046 ceph-mon[34147]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:09 smithi046 ceph-mon[34147]: Deploying daemon mgr.z on smithi078 2024-09-19T07:00:10.420 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 podman[36357]: 2024-09-19 07:00:10.134100677 +0000 UTC m=+0.110024260 container create 7c2cf35a47b3bc0116bc02e798fc6694b90d5d86ecb8fad21ea5cb69abf00d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T07:00:10.420 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 podman[36357]: 2024-09-19 07:00:10.039895679 +0000 UTC m=+0.015819263 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:00:10.420 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 podman[36357]: 2024-09-19 07:00:10.336365101 +0000 UTC m=+0.312288689 container init 7c2cf35a47b3bc0116bc02e798fc6694b90d5d86ecb8fad21ea5cb69abf00d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T07:00:10.420 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 podman[36357]: 2024-09-19 07:00:10.339047884 +0000 UTC m=+0.314971467 container start 7c2cf35a47b3bc0116bc02e798fc6694b90d5d86ecb8fad21ea5cb69abf00d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T07:00:10.420 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 ceph-mgr[36376]: -- 172.21.15.78:0/4087474996 <== mon.1 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2170230e0 con 0x55e217000800 2024-09-19T07:00:10.420 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 bash[36357]: 7c2cf35a47b3bc0116bc02e798fc6694b90d5d86ecb8fad21ea5cb69abf00d0e 2024-09-19T07:00:10.670 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 systemd[1]: Started Ceph mgr.z for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:00:10.671 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:10.464+0000 7f3a5b9b3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:00:10.671 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:10.523+0000 7f3a5b9b3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:00:10.671 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:10.670+0000 7f3a5b9b3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:00:10.945 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:10.735+0000 7f3a5b9b3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:00:10.946 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:10.880+0000 7f3a5b9b3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:00:11.131 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:00:11.158 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi029:vg_nvme/lv_4 2024-09-19T07:00:11.332 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:11.019+0000 7f3a5b9b3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:00:11.332 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:11.330+0000 7f3a5b9b3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:00:11.411 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:00:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:11.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-mon[34556]: Deploying daemon mgr.y on smithi046 2024-09-19T07:00:11.697 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:11.391+0000 7f3a5b9b3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:00:11.697 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:11.575+0000 7f3a5b9b3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:00:11.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:11.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:11.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:00:11.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:11.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:11.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:11 smithi029 ceph-mon[31255]: Deploying daemon mgr.y on smithi046 2024-09-19T07:00:11.828 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:11.828 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.828 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.828 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:11.828 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:11.829 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:00:11.829 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:11.829 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:11.829 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:11 smithi046 ceph-mon[34147]: Deploying daemon mgr.y on smithi046 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 -- 172.21.15.29:0/1558000866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8101c00 msgr2=0x7f94a8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 --2- 172.21.15.29:0/1558000866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8101c00 0x7f94a8102000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9498009900 tx=0x7f949802a410 comp rx=0 tx=0).stop 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 -- 172.21.15.29:0/1558000866 shutdown_connections 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 --2- 172.21.15.29:0/1558000866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a81037c0 0x7f94a810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 --2- 172.21.15.29:0/1558000866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94a8102e00 0x7f94a8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 --2- 172.21.15.29:0/1558000866 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8101c00 0x7f94a8102000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:11.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 -- 172.21.15.29:0/1558000866 >> 172.21.15.29:0/1558000866 conn(0x7f94a80fd390 msgr2=0x7f94a80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 -- 172.21.15.29:0/1558000866 shutdown_connections 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.869+0000 7f94ad346640 1 -- 172.21.15.29:0/1558000866 wait complete. 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 Processor -- start 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 -- start start 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94a8101c00 0x7f94a8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 0x7f94a8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a81037c0 0x7f94a819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f94a810d710 con 0x7f94a8102e00 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f94a810d590 con 0x7f94a8101c00 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94ad346640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94a810d890 con 0x7f94a81037c0 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94a67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 0x7f94a8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94a67fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 0x7f94a8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:60326/0 (socket says 172.21.15.29:60326) 2024-09-19T07:00:11.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94a67fc640 1 -- 172.21.15.29:0/1194095788 learned_addr learned my addr 172.21.15.29:0/1194095788 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94a6ffd640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94a8101c00 0x7f94a8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.870+0000 7f94a77fe640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a81037c0 0x7f94a819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94a67fc640 1 -- 172.21.15.29:0/1194095788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a81037c0 msgr2=0x7f94a819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94a67fc640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a81037c0 0x7f94a819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94a67fc640 1 -- 172.21.15.29:0/1194095788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94a8101c00 msgr2=0x7f94a8197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94a67fc640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94a8101c00 0x7f94a8197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94a67fc640 1 -- 172.21.15.29:0/1194095788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a819fa20 con 0x7f94a8102e00 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94a67fc640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 0x7f94a8198330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c890 tx=0x7f949c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c004220 con 0x7f94a8102e00 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f949c0043c0 con 0x7f94a8102e00 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a819fd10 con 0x7f94a8102e00 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c004a00 con 0x7f94a8102e00 2024-09-19T07:00:11.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.871+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a81a01f0 con 0x7f94a8102e00 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.872+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f949c004ba0 con 0x7f94a8102e00 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.872+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a81090a0 con 0x7f94a8102e00 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.872+0000 7f948ffff640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9490039500 0x7f949003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.872+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f949c04c570 con 0x7f94a8102e00 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.872+0000 7f94a6ffd640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9490039500 0x7f949003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.873+0000 7f94a6ffd640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9490039500 0x7f949003b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9498004770 tx=0x7f9498000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:11.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:11.877+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f949c014030 con 0x7f94a8102e00 2024-09-19T07:00:12.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:12.061+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f94a8062630 con 0x7f9490039500 2024-09-19T07:00:12.472 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 systemd[1]: Starting Ceph mgr.y for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:00:12.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:12 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:00:12.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:12 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:00:12.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:12 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 podman[35496]: 2024-09-19 07:00:12.471613296 +0000 UTC m=+0.103742074 container create 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 podman[35496]: 2024-09-19 07:00:12.3842199 +0000 UTC m=+0.016348695 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 podman[35496]: 2024-09-19 07:00:12.657008166 +0000 UTC m=+0.289136960 container init 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 podman[35496]: 2024-09-19 07:00:12.659860873 +0000 UTC m=+0.291989651 container start 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 ceph-mgr[35516]: -- 172.21.15.46:0/3457260708 <== mon.2 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55862d5790e0 con 0x55862d557000 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 bash[35496]: 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 2024-09-19T07:00:12.726 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 systemd[1]: Started Ceph mgr.y for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:00:12.809 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:12 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:00:12.809 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:12 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:00:12.809 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:12 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:12.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:12 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:00:13.161 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:12 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:00:13.161 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:12 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:13.161 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:12.452+0000 7f3a5b9b3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:00:13.161 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:12.520+0000 7f3a5b9b3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:00:13.162 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:12.787+0000 7fdc92aa7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:00:13.162 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:12.848+0000 7fdc92aa7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:00:13.162 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:13.009+0000 7fdc92aa7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:00:13.162 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:13.079+0000 7fdc92aa7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:00:13.407 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:13.253+0000 7fdc92aa7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:00:13.536 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.269+0000 7f3a5b9b3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.387+0000 7f3a5b9b3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:00:13.537 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.534+0000 7f3a5b9b3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:00:13.725 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:13.404+0000 7fdc92aa7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:00:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:13.751 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:13.825 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.603+0000 7f3a5b9b3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:00:13.825 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.754+0000 7f3a5b9b3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:00:13.826 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.824+0000 7f3a5b9b3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:00:14.018 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:13.750+0000 7fdc92aa7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:00:14.018 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:13.815+0000 7fdc92aa7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:00:14.018 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:14.016+0000 7fdc92aa7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:00:14.116 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:13.884+0000 7f3a5b9b3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:00:14.116 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:14.049+0000 7f3a5b9b3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:00:14.116 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:14.115+0000 7f3a5b9b3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:00:14.381 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:14.182+0000 7f3a5b9b3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:00:14.381 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:14.263+0000 7f3a5b9b3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:00:14.381 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:14.322+0000 7f3a5b9b3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:00:14.382 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:14.380+0000 7f3a5b9b3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:00:15.070 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:15.070 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: Reconfiguring daemon mgr.x on smithi029 2024-09-19T07:00:15.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2518020987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18b7cd4a-16e1-4292-8991-1c3e988879b9"}]: dispatch 2024-09-19T07:00:15.072 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2518020987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18b7cd4a-16e1-4292-8991-1c3e988879b9"}]': finished 2024-09-19T07:00:15.072 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:00:15.072 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:15.166 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:15.167 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: Reconfiguring daemon mgr.x on smithi029 2024-09-19T07:00:15.168 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2518020987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18b7cd4a-16e1-4292-8991-1c3e988879b9"}]: dispatch 2024-09-19T07:00:15.168 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2518020987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18b7cd4a-16e1-4292-8991-1c3e988879b9"}]': finished 2024-09-19T07:00:15.168 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:00:15.168 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:15.225 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:14.953+0000 7fdc92aa7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:00:15.225 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:15.024+0000 7fdc92aa7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:00:15.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: Reconfiguring daemon mgr.x on smithi029 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2518020987' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18b7cd4a-16e1-4292-8991-1c3e988879b9"}]: dispatch 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2518020987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18b7cd4a-16e1-4292-8991-1c3e988879b9"}]': finished 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:00:15.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:15.445 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z[36372]: 2024-09-19T07:00:15.165+0000 7f3a5b9b3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:00:15.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:15.806+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f949c00f450 con 0x7f94a8102e00 2024-09-19T07:00:16.065 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:15.791+0000 7fdc92aa7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:00:16.065 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:15.913+0000 7fdc92aa7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:00:16.065 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3636313378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:00:16.066 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-mon[34147]: Standby manager daemon z started 2024-09-19T07:00:16.066 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:00:16.066 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:00:16.066 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:00:16.066 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:15 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:00:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:15 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3636313378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:00:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:15 smithi029 ceph-mon[31255]: Standby manager daemon z started 2024-09-19T07:00:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:15 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:00:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:15 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:00:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:15 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:00:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:15 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:00:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3636313378' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:00:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-mon[34556]: Standby manager daemon z started 2024-09-19T07:00:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:00:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:00:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:00:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:15 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.78:0/107172721' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:00:16.357 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.063+0000 7fdc92aa7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:00:16.358 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.127+0000 7fdc92aa7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:00:16.358 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.284+0000 7fdc92aa7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:00:16.358 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.355+0000 7fdc92aa7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:00:16.655 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.418+0000 7fdc92aa7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:00:16.655 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.584+0000 7fdc92aa7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:00:16.655 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.653+0000 7fdc92aa7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:00:16.936 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-mon[34147]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:16.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-mon[34147]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T07:00:16.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:00:16.937 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.723+0000 7fdc92aa7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:00:16.937 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.810+0000 7fdc92aa7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:00:16.937 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.872+0000 7fdc92aa7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:00:16.937 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:16.934+0000 7fdc92aa7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:00:17.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:16 smithi029 ceph-mon[31255]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:17.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:16 smithi029 ceph-mon[31255]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T07:00:17.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:16 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:00:17.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:16 smithi078 ceph-mon[34556]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:17.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:16 smithi078 ceph-mon[34556]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T07:00:17.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:16 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:00:17.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:17.814+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mon.0 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f949c0173b0 con 0x7f94a8102e00 2024-09-19T07:00:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:17 smithi029 ceph-mon[31255]: Standby manager daemon y started 2024-09-19T07:00:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:17 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:00:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:17 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:00:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:17 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:00:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:17 smithi029 ceph-mon[31255]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:00:18.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:17 smithi078 ceph-mon[34556]: Standby manager daemon y started 2024-09-19T07:00:18.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:17 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:00:18.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:17 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:00:18.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:17 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:00:18.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:17 smithi078 ceph-mon[34556]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:00:18.225 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:00:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y[35512]: 2024-09-19T07:00:17.769+0000 7fdc92aa7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:00:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:17 smithi046 ceph-mon[34147]: Standby manager daemon y started 2024-09-19T07:00:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:17 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:00:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:17 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:00:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:17 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:00:18.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:17 smithi046 ceph-mon[34147]: from='mgr.? 172.21.15.46:0/46371479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:00:19.070 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:18 smithi029 ceph-mon[31255]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:19.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:18 smithi029 ceph-mon[31255]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T07:00:19.071 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:00:19.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:18 smithi078 ceph-mon[34556]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:19.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:18 smithi078 ceph-mon[34556]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T07:00:19.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:00:19.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:18 smithi046 ceph-mon[34147]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:19.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:18 smithi046 ceph-mon[34147]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T07:00:19.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:00:21.116 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:20 smithi029 ceph-mon[31255]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:21.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:20 smithi078 ceph-mon[34556]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:21.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:20 smithi046 ceph-mon[34147]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:22.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:22.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:22.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:22.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.504 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.504 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:22.504 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:22.504 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:22.504 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:22.504 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:23.403 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:23 smithi029 ceph-mon[31255]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:23.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:23 smithi078 ceph-mon[34556]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:23 smithi046 ceph-mon[34147]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:24 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:00:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:24 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:24 smithi029 ceph-mon[31255]: Deploying daemon osd.0 on smithi029 2024-09-19T07:00:24.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:24 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:00:24.459 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:24 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:24.460 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:24 smithi078 ceph-mon[34556]: Deploying daemon osd.0 on smithi029 2024-09-19T07:00:24.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:24 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:00:24.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:24 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:24.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:24 smithi046 ceph-mon[34147]: Deploying daemon osd.0 on smithi029 2024-09-19T07:00:25.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:25 smithi046 ceph-mon[34147]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:25 smithi029 ceph-mon[31255]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:25.656 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:25 smithi078 ceph-mon[34556]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:27.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:27 smithi046 ceph-mon[34147]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:27.511 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:27 smithi029 ceph-mon[31255]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:27 smithi078 ceph-mon[34556]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:29.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:29 smithi046 ceph-mon[34147]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:29.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:29 smithi029 ceph-mon[31255]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:29 smithi078 ceph-mon[34556]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:31.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:31 smithi046 ceph-mon[34147]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:31.501 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:31 smithi029 ceph-mon[31255]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:31 smithi078 ceph-mon[34556]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:33.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:33 smithi046 ceph-mon[34147]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:33.539 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:33 smithi029 ceph-mon[31255]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:33.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:33 smithi078 ceph-mon[34556]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:35.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:35 smithi078 ceph-mon[34556]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:35.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:35.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:35.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:35.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:35 smithi046 ceph-mon[34147]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:35.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:35.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:35.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:35.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:35 smithi029 ceph-mon[31255]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:35.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:35.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:35.613 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:37 smithi029 ceph-mon[31255]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:37.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:37.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:37.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:37 smithi046 ceph-mon[34147]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:37.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:37.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:37.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:37 smithi078 ceph-mon[34556]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:38.744 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 0 on host 'smithi029' 2024-09-19T07:00:38.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.743+0000 7f948ffff640 1 -- 172.21.15.29:0/1194095788 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f94a8062630 con 0x7f9490039500 2024-09-19T07:00:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.745+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9490039500 msgr2=0x7f949003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:38.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.745+0000 7f94ad346640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9490039500 0x7f949003b9c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9498004770 tx=0x7f9498000bc0 comp rx=0 tx=0).stop 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.745+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 msgr2=0x7f94a8198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.745+0000 7f94ad346640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 0x7f94a8198330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c890 tx=0x7f949c00cd50 comp rx=0 tx=0).stop 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.745+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 shutdown_connections 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9490039500 0x7f949003b9c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94a81037c0 0x7f94a819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94a8102e00 0x7f94a8198330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 --2- 172.21.15.29:0/1194095788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94a8101c00 0x7f94a8197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 >> 172.21.15.29:0/1194095788 conn(0x7f94a80fd390 msgr2=0x7f94a8106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 shutdown_connections 2024-09-19T07:00:38.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:00:38.746+0000 7f94ad346640 1 -- 172.21.15.29:0/1194095788 wait complete. 2024-09-19T07:00:39.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:39 smithi029 ceph-mon[31255]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:39.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:39.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:39.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:39.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:39 smithi046 ceph-mon[34147]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:39.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:39.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:39.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:39.498 DEBUG:teuthology.orchestra.run.smithi029:osd.0> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T07:00:39.500 INFO:tasks.cephadm:Deploying osd.1 on smithi046 with /dev/vg_nvme/lv_4... 2024-09-19T07:00:39.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:00:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:39 smithi078 ceph-mon[34556]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:00:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:39.764 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:00:40.624 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:00:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0[45083]: 2024-09-19T07:00:40.320+0000 7f0cdf7d3640 -1 osd.0 0 log_to_monitors true 2024-09-19T07:00:41.425 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:41 smithi046 ceph-mon[34147]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:41.425 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:41 smithi046 ceph-mon[34147]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:00:41.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:41 smithi029 ceph-mon[31255]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:41.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:41 smithi029 ceph-mon[31255]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:00:41.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:41 smithi078 ceph-mon[34556]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:41 smithi078 ceph-mon[34556]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:00:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T07:00:42.210 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-09-19T07:00:42.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:42 smithi029 ceph-mon[31255]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:00:42.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:42 smithi029 ceph-mon[31255]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:00:42.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:42 smithi029 ceph-mon[31255]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:00:42.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:42.375 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:00:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0[45083]: 2024-09-19T07:00:42.238+0000 7f0cdb756640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T07:00:42.375 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:00:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0[45083]: 2024-09-19T07:00:42.241+0000 7f0cd757e640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:00:42.465 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:00:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:42 smithi046 ceph-mon[34147]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:00:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:42 smithi046 ceph-mon[34147]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:00:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:42 smithi046 ceph-mon[34147]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:00:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:42 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:42.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:42 smithi078 ceph-mon[34556]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:00:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:42 smithi078 ceph-mon[34556]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:00:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:42 smithi078 ceph-mon[34556]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:00:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:42 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 -- 172.21.15.46:0/726676501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8104fb0 msgr2=0x7f8ff81073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 --2- 172.21.15.46:0/726676501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8104fb0 0x7f8ff81073a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009900 tx=0x7f8fec02a410 comp rx=0 tx=0).stop 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 -- 172.21.15.46:0/726676501 shutdown_connections 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 --2- 172.21.15.46:0/726676501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ff81078e0 0x7f8ff8109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 --2- 172.21.15.46:0/726676501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8104fb0 0x7f8ff81073a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 --2- 172.21.15.46:0/726676501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff8102680 0x7f8ff8104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 -- 172.21.15.46:0/726676501 >> 172.21.15.46:0/726676501 conn(0x7f8ff80fc2a0 msgr2=0x7f8ff80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 -- 172.21.15.46:0/726676501 shutdown_connections 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.935+0000 7f8ffd437640 1 -- 172.21.15.46:0/726676501 wait complete. 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 Processor -- start 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 -- start start 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 0x7f8ff8101fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ff8104fb0 0x7f8ff8100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81078e0 0x7f8ff8100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810d850 con 0x7f8ff8104fb0 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810d6d0 con 0x7f8ff8102680 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ffd437640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff810d9d0 con 0x7f8ff81078e0 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ff6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 0x7f8ff8101fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ff6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 0x7f8ff8101fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48044/0 (socket says 172.21.15.46:48044) 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.936+0000 7f8ff6ffd640 1 -- 172.21.15.46:0/1575196436 learned_addr learned my addr 172.21.15.46:0/1575196436 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff67fc640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ff8104fb0 0x7f8ff8100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff77fe640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81078e0 0x7f8ff8100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff6ffd640 1 -- 172.21.15.46:0/1575196436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81078e0 msgr2=0x7f8ff8100b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff6ffd640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81078e0 0x7f8ff8100b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff6ffd640 1 -- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ff8104fb0 msgr2=0x7f8ff8100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff6ffd640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ff8104fb0 0x7f8ff8100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff6ffd640 1 -- 172.21.15.46:0/1575196436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff8101430 con 0x7f8ff8102680 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff77fe640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81078e0 0x7f8ff8100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ff6ffd640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 0x7f8ff8101fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b4a0 tx=0x7f8fe800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8014070 con 0x7f8ff8102680 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8fe8010ac0 con 0x7f8ff8102680 2024-09-19T07:00:42.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff81a2180 con 0x7f8ff8102680 2024-09-19T07:00:42.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8017c30 con 0x7f8ff8102680 2024-09-19T07:00:42.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.937+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff81a2710 con 0x7f8ff8102680 2024-09-19T07:00:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.939+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff80fdd90 con 0x7f8ff8102680 2024-09-19T07:00:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.940+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f8fe8017070 con 0x7f8ff8102680 2024-09-19T07:00:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.941+0000 7f8fdffff640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8fe00a31b0 0x7f8fe00a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.941+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f8fe80cd410 con 0x7f8ff8102680 2024-09-19T07:00:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.941+0000 7f8ff67fc640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8fe00a31b0 0x7f8fe00a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:42.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.942+0000 7f8ff67fc640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8fe00a31b0 0x7f8fe00a5670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8fec005ab0 tx=0x7f8fec005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:42.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:42.949+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8fe809bcc0 con 0x7f8ff8102680 2024-09-19T07:00:43.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:00:43.139+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8ff8062630 con 0x7f8fe00a31b0 2024-09-19T07:00:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:00:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi029 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi029 to 17092M 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:43.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:00:43.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:00:43.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:43.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi029 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi029 to 17092M 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:43.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:43.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:00:43.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:00:43.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:43.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi029 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi029 to 17092M 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:43.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:00:43.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:00:43.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:00:43.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:00:43.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:43.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:44.514 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:44 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:00:44.514 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:44 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:00:44.514 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:44 smithi046 ceph-mon[34147]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:44.514 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:44 smithi046 ceph-mon[34147]: osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] boot 2024-09-19T07:00:44.515 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:44 smithi046 ceph-mon[34147]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:00:44.515 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:44.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:44 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:00:44.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:44 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:00:44.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:44 smithi029 ceph-mon[31255]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:44.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:44 smithi029 ceph-mon[31255]: osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] boot 2024-09-19T07:00:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:44 smithi029 ceph-mon[31255]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:00:44.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:44.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:44 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:00:44.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:44 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:00:44.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:44 smithi078 ceph-mon[34556]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:44.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:44 smithi078 ceph-mon[34556]: osd.0 [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] boot 2024-09-19T07:00:44.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:44 smithi078 ceph-mon[34556]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:00:44.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:00:45.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:45 smithi046 ceph-mon[34147]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:45.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:45 smithi046 ceph-mon[34147]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T07:00:45.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:45 smithi029 ceph-mon[31255]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:45.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:45 smithi029 ceph-mon[31255]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T07:00:45.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:45 smithi078 ceph-mon[34556]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:00:45.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:45 smithi078 ceph-mon[34556]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T07:00:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:46 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/3388358125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]: dispatch 2024-09-19T07:00:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:46 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]: dispatch 2024-09-19T07:00:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:46 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]': finished 2024-09-19T07:00:46.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:46 smithi046 ceph-mon[34147]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:00:46.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:00:46.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:46 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/2166697774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:00:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:46 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/3388358125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]: dispatch 2024-09-19T07:00:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:46 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]: dispatch 2024-09-19T07:00:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:46 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]': finished 2024-09-19T07:00:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:46 smithi029 ceph-mon[31255]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:00:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:00:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:46 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/2166697774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:00:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:46 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/3388358125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]: dispatch 2024-09-19T07:00:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:46 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]: dispatch 2024-09-19T07:00:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:46 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14b5d96f-091a-4d2c-99b2-204239338305"}]': finished 2024-09-19T07:00:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:46 smithi078 ceph-mon[34556]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:00:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:00:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:46 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/2166697774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:00:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:47 smithi029 ceph-mon[31255]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:47.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:47 smithi078 ceph-mon[34556]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:47 smithi046 ceph-mon[34147]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:49.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:49 smithi029 ceph-mon[31255]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:49 smithi078 ceph-mon[34556]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:49 smithi046 ceph-mon[34147]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:51.849 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:51 smithi046 ceph-mon[34147]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:51.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:51 smithi029 ceph-mon[31255]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:51.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:51 smithi078 ceph-mon[34556]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:53.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:53 smithi029 ceph-mon[31255]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:53.917 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:53 smithi046 ceph-mon[34147]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:53 smithi078 ceph-mon[34556]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:54.695 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:54 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:00:54.695 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:54 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:54.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:54 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:00:54.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:54 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:54.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:54 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:00:54.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:54 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:00:55.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:55 smithi029 ceph-mon[31255]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:55.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:55 smithi029 ceph-mon[31255]: Deploying daemon osd.1 on smithi046 2024-09-19T07:00:55.875 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:55 smithi046 ceph-mon[34147]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:55.875 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:55 smithi046 ceph-mon[34147]: Deploying daemon osd.1 on smithi046 2024-09-19T07:00:55.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:55 smithi078 ceph-mon[34556]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:55 smithi078 ceph-mon[34556]: Deploying daemon osd.1 on smithi046 2024-09-19T07:00:57.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:57 smithi046 ceph-mon[34147]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:57.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:57 smithi029 ceph-mon[31255]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:57 smithi078 ceph-mon[34556]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:59.679 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:00:59 smithi046 ceph-mon[34147]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:59.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:00:59 smithi029 ceph-mon[31255]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:00:59.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:00:59 smithi078 ceph-mon[34556]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:00.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:00 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:00.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:00 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:00.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:00 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:01 smithi029 ceph-mon[31255]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:01.684 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:01 smithi046 ceph-mon[34147]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:01.684 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:01.684 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:01.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:01 smithi078 ceph-mon[34556]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:01.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:01.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:03 smithi029 ceph-mon[31255]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:03.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:03 smithi078 ceph-mon[34556]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:03 smithi046 ceph-mon[34147]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:03.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:04.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.781+0000 7f8fdffff640 1 -- 172.21.15.46:0/1575196436 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8ff8062630 con 0x7f8fe00a31b0 2024-09-19T07:01:04.782 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 1 on host 'smithi046' 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8fe00a31b0 msgr2=0x7f8fe00a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8fe00a31b0 0x7f8fe00a5670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8fec005ab0 tx=0x7f8fec005a20 comp rx=0 tx=0).stop 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 msgr2=0x7f8ff8101fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 0x7f8ff8101fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b4a0 tx=0x7f8fe800b960 comp rx=0 tx=0).stop 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 shutdown_connections 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8fe00a31b0 0x7f8fe00a5670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ff81078e0 0x7f8ff8100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ff8104fb0 0x7f8ff8100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 --2- 172.21.15.46:0/1575196436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ff8102680 0x7f8ff8101fe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 >> 172.21.15.46:0/1575196436 conn(0x7f8ff80fc2a0 msgr2=0x7f8ff81030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 shutdown_connections 2024-09-19T07:01:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:01:04.784+0000 7f8ffd437640 1 -- 172.21.15.46:0/1575196436 wait complete. 2024-09-19T07:01:05.436 DEBUG:teuthology.orchestra.run.smithi046:osd.1> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T07:01:05.439 INFO:tasks.cephadm:Deploying osd.2 on smithi078 with /dev/vg_nvme/lv_4... 2024-09-19T07:01:05.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:01:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:01:05.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:05 smithi046 ceph-mon[34147]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:05.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:05.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:05.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:05.812 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:05 smithi078 ceph-mon[34556]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:05.813 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:05.813 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:05.813 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:05.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:05 smithi029 ceph-mon[31255]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:05.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:05.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:05.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:06.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:06 smithi046 ceph-mon[34147]: from='osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:01:06.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:06 smithi046 ceph-mon[34147]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:01:06.726 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1[38609]: 2024-09-19T07:01:06.406+0000 7f76b763c640 -1 osd.1 0 log_to_monitors true 2024-09-19T07:01:06.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:06 smithi078 ceph-mon[34556]: from='osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:01:06.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:06 smithi078 ceph-mon[34556]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:01:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:06 smithi029 ceph-mon[31255]: from='osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:01:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:06 smithi029 ceph-mon[31255]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:01:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:07 smithi078 ceph-mon[34556]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:07 smithi078 ceph-mon[34556]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:01:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:07 smithi078 ceph-mon[34556]: from='osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:01:07.857 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:07 smithi078 ceph-mon[34556]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:01:07.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:07.858 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:07 smithi078 ceph-mon[34556]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:01:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:07 smithi029 ceph-mon[31255]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:07 smithi029 ceph-mon[31255]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:01:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:07 smithi029 ceph-mon[31255]: from='osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:01:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:07 smithi029 ceph-mon[31255]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:01:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:07.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:07 smithi029 ceph-mon[31255]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:01:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:07 smithi046 ceph-mon[34147]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:07 smithi046 ceph-mon[34147]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:01:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:07 smithi046 ceph-mon[34147]: from='osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:01:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:07 smithi046 ceph-mon[34147]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:01:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:07.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:07 smithi046 ceph-mon[34147]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:01:08.137 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T07:01:08.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_4 2024-09-19T07:01:08.428 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:01:08.447 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1[38609]: 2024-09-19T07:01:08.092+0000 7f76b35bf640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T07:01:08.447 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1[38609]: 2024-09-19T07:01:08.096+0000 7f76ab3df640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:01:08.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:01:08.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T07:01:08.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='osd.1 ' entity='osd.1' 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:08.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='osd.1 ' entity='osd.1' 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:01:08.730 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.731 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:08.731 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:08.731 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='osd.1 ' entity='osd.1' 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:01:08.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:08.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:08.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:08.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3968630127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0102690 msgr2=0x7fc9c0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3968630127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0102690 0x7fc9c0108f20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009900 tx=0x7fc9b802a410 comp rx=0 tx=0).stop 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3968630127 shutdown_connections 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3968630127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0102690 0x7fc9c0108f20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3968630127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0101cd0 0x7fc9c0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3968630127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9c0100ad0 0x7fc9c0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3968630127 >> 172.21.15.78:0/3968630127 conn(0x7fc9c00fc280 msgr2=0x7fc9c00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3968630127 shutdown_connections 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.968+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3968630127 wait complete. 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 Processor -- start 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 -- start start 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 0x7fc9c006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9c0101cd0 0x7fc9c019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:08.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0102690 0x7fc9c019f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c010c700 con 0x7fc9c0101cd0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c010c580 con 0x7fc9c0102690 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9c60a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c010c880 con 0x7fc9c0100ad0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 0x7fc9c006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 0x7fc9c006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38582/0 (socket says 172.21.15.78:38582) 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.969+0000 7fc9bf7fe640 1 -- 172.21.15.78:0/3115291832 learned_addr learned my addr 172.21.15.78:0/3115291832 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bffff640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0102690 0x7fc9c019f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9beffd640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9c0101cd0 0x7fc9c019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bf7fe640 1 -- 172.21.15.78:0/3115291832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0102690 msgr2=0x7fc9c019f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bf7fe640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0102690 0x7fc9c019f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bf7fe640 1 -- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9c0101cd0 msgr2=0x7fc9c019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bf7fe640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9c0101cd0 0x7fc9c019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bf7fe640 1 -- 172.21.15.78:0/3115291832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c019fbe0 con 0x7fc9c0100ad0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bf7fe640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 0x7fc9c006aad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000b9c0 tx=0x7fc9b000bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:08.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0019070 con 0x7fc9c0100ad0 2024-09-19T07:01:08.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9b0014440 con 0x7fc9c0100ad0 2024-09-19T07:01:08.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00125a0 con 0x7fc9c0100ad0 2024-09-19T07:01:08.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c019fe70 con 0x7fc9c0100ad0 2024-09-19T07:01:08.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.970+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c01a0350 con 0x7fc9c0100ad0 2024-09-19T07:01:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.971+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c0107fb0 con 0x7fc9c0100ad0 2024-09-19T07:01:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.972+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fc9b001c070 con 0x7fc9c0100ad0 2024-09-19T07:01:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.973+0000 7fc9bcff9640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc9a80a31b0 0x7fc9a80a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.973+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fc9b00cd450 con 0x7fc9c0100ad0 2024-09-19T07:01:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.973+0000 7fc9beffd640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc9a80a31b0 0x7fc9a80a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:08.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.974+0000 7fc9beffd640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc9a80a31b0 0x7fc9a80a5670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006b050 tx=0x7fc9b4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:08.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:08.977+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9b009b490 con 0x7fc9c0100ad0 2024-09-19T07:01:09.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:09.161+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc9c0062630 con 0x7fc9a80a31b0 2024-09-19T07:01:09.736 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:01:09.736 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:01:09.736 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:09.736 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi046 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] boot 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:01:09.737 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi046 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:09.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] boot 2024-09-19T07:01:09.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:01:09.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:09.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:01:09.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:01:09.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:01:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:01:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:01:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi046 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: osd.1 [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] boot 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:01:09.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:10.872 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:10 smithi078 ceph-mon[34556]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:10.873 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:10 smithi078 ceph-mon[34556]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T07:01:10.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:10 smithi029 ceph-mon[31255]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:10.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:10 smithi029 ceph-mon[31255]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T07:01:10.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:10 smithi046 ceph-mon[34147]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:10.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:10 smithi046 ceph-mon[34147]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T07:01:11.862 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:11 smithi078 ceph-mon[34556]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:11.862 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:11 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/4209888240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]: dispatch 2024-09-19T07:01:11.863 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:11 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]: dispatch 2024-09-19T07:01:11.863 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:11 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]': finished 2024-09-19T07:01:11.863 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:11 smithi078 ceph-mon[34556]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:01:11.863 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:11 smithi029 ceph-mon[31255]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:11 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/4209888240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]: dispatch 2024-09-19T07:01:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:11 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]: dispatch 2024-09-19T07:01:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:11 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]': finished 2024-09-19T07:01:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:11 smithi029 ceph-mon[31255]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:01:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:11 smithi046 ceph-mon[34147]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:11 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/4209888240' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]: dispatch 2024-09-19T07:01:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:11 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]: dispatch 2024-09-19T07:01:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:11 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5"}]': finished 2024-09-19T07:01:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:11 smithi046 ceph-mon[34147]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:01:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:12.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:12 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/375435565' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:01:12.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:12 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/375435565' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:01:12.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:12 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/375435565' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:01:13.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:13 smithi029 ceph-mon[31255]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:13.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:13 smithi078 ceph-mon[34556]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:13 smithi046 ceph-mon[34147]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:15.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:15 smithi029 ceph-mon[31255]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:15.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:15 smithi078 ceph-mon[34556]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:15 smithi046 ceph-mon[34147]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:17.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:17 smithi029 ceph-mon[31255]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:17.932 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:17 smithi078 ceph-mon[34556]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:17.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:17 smithi046 ceph-mon[34147]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:19.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:19 smithi029 ceph-mon[31255]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:19.904 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:19 smithi078 ceph-mon[34556]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:19.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:19 smithi046 ceph-mon[34147]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:01:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:20.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:01:20.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:21.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:01:21.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:21.794 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:21 smithi078 ceph-mon[34556]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:21.794 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:21 smithi078 ceph-mon[34556]: Deploying daemon osd.2 on smithi078 2024-09-19T07:01:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:21 smithi046 ceph-mon[34147]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:21 smithi046 ceph-mon[34147]: Deploying daemon osd.2 on smithi078 2024-09-19T07:01:22.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:21 smithi029 ceph-mon[31255]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:22.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:21 smithi029 ceph-mon[31255]: Deploying daemon osd.2 on smithi078 2024-09-19T07:01:23.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:23 smithi078 ceph-mon[34556]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:23.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:23 smithi046 ceph-mon[34147]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:23 smithi029 ceph-mon[31255]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:25.732 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:25 smithi078 ceph-mon[34556]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:25.926 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:25 smithi029 ceph-mon[31255]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:25 smithi046 ceph-mon[34147]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:26.892 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:26.892 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:26.892 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:26.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:26.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:26.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:27.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:27.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:27.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:27.918 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:27 smithi078 ceph-mon[34556]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:27 smithi046 ceph-mon[34147]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:27 smithi029 ceph-mon[31255]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:29 smithi078 ceph-mon[34556]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:29.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:29 smithi046 ceph-mon[34147]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:29 smithi029 ceph-mon[31255]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.448+0000 7fc9bcff9640 1 -- 172.21.15.78:0/3115291832 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9c0062630 con 0x7fc9a80a31b0 2024-09-19T07:01:30.450 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 2 on host 'smithi078' 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.450+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc9a80a31b0 msgr2=0x7fc9a80a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.450+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc9a80a31b0 0x7fc9a80a5670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006b050 tx=0x7fc9b4009110 comp rx=0 tx=0).stop 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.450+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 msgr2=0x7fc9c006aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.450+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 0x7fc9c006aad0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000b9c0 tx=0x7fc9b000bdc0 comp rx=0 tx=0).stop 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 shutdown_connections 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9c0102690 0x7fc9c019f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc9c0101cd0 0x7fc9c019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc9a80a31b0 0x7fc9a80a5670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 --2- 172.21.15.78:0/3115291832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9c0100ad0 0x7fc9c006aad0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 >> 172.21.15.78:0/3115291832 conn(0x7fc9c00fc280 msgr2=0x7fc9c0105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 shutdown_connections 2024-09-19T07:01:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:01:30.451+0000 7fc9c60a0640 1 -- 172.21.15.78:0/3115291832 wait complete. 2024-09-19T07:01:31.116 DEBUG:teuthology.orchestra.run.smithi078:osd.2> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T07:01:31.119 INFO:tasks.cephadm:Deploying osd.3 on smithi029 with /dev/vg_nvme/lv_3... 2024-09-19T07:01:31.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:01:31.383 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:01:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:31 smithi078 ceph-mon[34556]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:31 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:31 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:31 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:31.696 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:31 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2[39547]: 2024-09-19T07:01:31.602+0000 7f5a0268c640 -1 osd.2 0 log_to_monitors true 2024-09-19T07:01:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:31 smithi046 ceph-mon[34147]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:31 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:31 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:31 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:31.858 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:31 smithi029 ceph-mon[31255]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:31.858 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:31 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:31.858 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:31 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:31.858 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:31 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:32.553 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:32 smithi078 ceph-mon[34556]: from='osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:01:32.554 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:32 smithi078 ceph-mon[34556]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:01:32.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:32 smithi029 ceph-mon[31255]: from='osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:01:32.705 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:32 smithi029 ceph-mon[31255]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:01:32.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:32 smithi046 ceph-mon[34147]: from='osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:01:32.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:32 smithi046 ceph-mon[34147]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:01:33.635 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:33 smithi078 ceph-mon[34556]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:33.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:33 smithi078 ceph-mon[34556]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:01:33.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:33 smithi078 ceph-mon[34556]: from='osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:01:33.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:33 smithi078 ceph-mon[34556]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:01:33.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:33 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:33.636 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:33 smithi078 ceph-mon[34556]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:01:33.730 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:33 smithi046 ceph-mon[34147]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:33.731 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:33 smithi046 ceph-mon[34147]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:01:33.731 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:33 smithi046 ceph-mon[34147]: from='osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:01:33.731 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:33 smithi046 ceph-mon[34147]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:01:33.731 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:33 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:33.731 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:33 smithi046 ceph-mon[34147]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:01:33.799 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:33 smithi029 ceph-mon[31255]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:33.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:33 smithi029 ceph-mon[31255]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:01:33.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:33 smithi029 ceph-mon[31255]: from='osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:01:33.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:33 smithi029 ceph-mon[31255]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:01:33.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:33 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:33.800 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:33 smithi029 ceph-mon[31255]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:01:34.151 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:01:34.178 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi029:vg_nvme/lv_3 2024-09-19T07:01:34.432 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2[39547]: 2024-09-19T07:01:34.114+0000 7f59fe60f640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T07:01:34.432 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2[39547]: 2024-09-19T07:01:34.119+0000 7f59f642f640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:01:34.434 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:34 smithi078 ceph-mon[34556]: from='osd.2 ' entity='osd.2' 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:34.697 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.698 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:34 smithi029 ceph-mon[31255]: from='osd.2 ' entity='osd.2' 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:01:34.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:34.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:34.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:34.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:34 smithi046 ceph-mon[34147]: from='osd.2 ' entity='osd.2' 2024-09-19T07:01:34.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 -- 172.21.15.29:0/1956948999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c102e00 msgr2=0x7f963c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 --2- 172.21.15.29:0/1956948999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c102e00 0x7f963c103280 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9624009900 tx=0x7f962402a410 comp rx=0 tx=0).stop 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 -- 172.21.15.29:0/1956948999 shutdown_connections 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 --2- 172.21.15.29:0/1956948999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f963c1037c0 0x7f963c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 --2- 172.21.15.29:0/1956948999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c102e00 0x7f963c103280 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 --2- 172.21.15.29:0/1956948999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c101c00 0x7f963c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.941+0000 7f9641b5e640 1 -- 172.21.15.29:0/1956948999 >> 172.21.15.29:0/1956948999 conn(0x7f963c0fd390 msgr2=0x7f963c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.942+0000 7f9641b5e640 1 -- 172.21.15.29:0/1956948999 shutdown_connections 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.942+0000 7f9641b5e640 1 -- 172.21.15.29:0/1956948999 wait complete. 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.942+0000 7f9641b5e640 1 Processor -- start 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.942+0000 7f9641b5e640 1 -- start start 2024-09-19T07:01:34.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.942+0000 7f9641b5e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 0x7f963c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.942+0000 7f9641b5e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c102e00 0x7f963c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9641b5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f963c1037c0 0x7f963c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9641b5e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f963c10d710 con 0x7f963c101c00 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9641b5e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f963c10d590 con 0x7f963c102e00 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9641b5e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f963c10d890 con 0x7f963c1037c0 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 0x7f963c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 0x7f963c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:51354/0 (socket says 172.21.15.29:51354) 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 -- 172.21.15.29:0/3210485017 learned_addr learned my addr 172.21.15.29:0/3210485017 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963bfff640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f963c1037c0 0x7f963c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963affd640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c102e00 0x7f963c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 -- 172.21.15.29:0/3210485017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f963c1037c0 msgr2=0x7f963c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:34.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f963c1037c0 0x7f963c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 -- 172.21.15.29:0/3210485017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c102e00 msgr2=0x7f963c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c102e00 0x7f963c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 -- 172.21.15.29:0/3210485017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c0753e0 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f963b7fe640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 0x7f963c075f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f962c00ea80 tx=0x7f962c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c00ce40 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c1a1fb0 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.943+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f962c011920 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.944+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c01aaa0 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.944+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c1a2400 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.945+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c1090c0 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.946+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f962c011ad0 con 0x7f963c101c00 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.947+0000 7f9638ff9640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96280a31b0 0x7f96280a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.947+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f962c0ce6c0 con 0x7f963c101c00 2024-09-19T07:01:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.947+0000 7f963affd640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96280a31b0 0x7f96280a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.947+0000 7f963affd640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96280a31b0 0x7f96280a5670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9624006010 tx=0x7f9624000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:34.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:34.951+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f962c016030 con 0x7f963c101c00 2024-09-19T07:01:35.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:35.135+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f963c062630 con 0x7f96280a31b0 2024-09-19T07:01:35.683 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:01:35.683 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:01:35.684 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:35.684 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi078 2024-09-19T07:01:35.684 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi078 to 17088M 2024-09-19T07:01:35.684 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:35.684 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] boot 2024-09-19T07:01:35.685 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:01:35.685 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:35.685 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:01:35.685 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:01:35.685 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:35.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi078 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi078 to 17088M 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] boot 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:01:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:01:35.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:01:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:01:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:01:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi078 2024-09-19T07:01:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi078 to 17088M 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: osd.2 [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] boot 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:01:35.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:36.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:36 smithi078 ceph-mon[34556]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:36.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:36 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:01:36.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:36 smithi046 ceph-mon[34147]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:36.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:36 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:01:36.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:36 smithi029 ceph-mon[31255]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:36.736 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:01:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:37 smithi029 ceph-mon[31255]: pgmap v79: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:01:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:37 smithi029 ceph-mon[31255]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T07:01:37.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:01:37.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:37 smithi078 ceph-mon[34556]: pgmap v79: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:01:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:37 smithi078 ceph-mon[34556]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T07:01:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:01:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:37 smithi046 ceph-mon[34147]: pgmap v79: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:01:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:37 smithi046 ceph-mon[34147]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T07:01:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:01:38.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:37 smithi029 sudo[49788]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:01:38.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:37 smithi029 sudo[49788]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:38.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:37 smithi029 sudo[49788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:38.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:37 smithi029 sudo[49788]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:38.624 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:38 smithi029 sudo[49813]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:01:38.624 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:38 smithi029 sudo[49813]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:38.624 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:38 smithi029 sudo[49813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:38.625 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:01:38 smithi029 sudo[49813]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1617232010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fba4b13-f243-4dad-a64c-1f374ee7fdc8"}]: dispatch 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1617232010' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fba4b13-f243-4dad-a64c-1f374ee7fdc8"}]': finished 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:01:38.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2109768086' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:01:38.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:38.646+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f962c098aa0 con 0x7f963c101c00 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1617232010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fba4b13-f243-4dad-a64c-1f374ee7fdc8"}]: dispatch 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1617232010' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fba4b13-f243-4dad-a64c-1f374ee7fdc8"}]': finished 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:01:38.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2109768086' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1617232010' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fba4b13-f243-4dad-a64c-1f374ee7fdc8"}]: dispatch 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1617232010' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fba4b13-f243-4dad-a64c-1f374ee7fdc8"}]': finished 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:01:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2109768086' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:01:39.225 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:38 smithi046 sudo[42290]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:01:39.225 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:38 smithi046 sudo[42290]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:39.225 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:38 smithi046 sudo[42290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:39.225 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:38 smithi046 sudo[42290]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:39 smithi046 ceph-mon[34147]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:39 smithi046 ceph-mon[34147]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:01:39.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:39.726 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:39 smithi046 sudo[42293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:01:39.726 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:39 smithi046 sudo[42293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:39.726 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:39 smithi046 sudo[42293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:39.726 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:01:39 smithi046 sudo[42293]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:39 smithi029 ceph-mon[31255]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:39 smithi029 ceph-mon[31255]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:01:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:39.898 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43324]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:01:39.899 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43324]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:39.899 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:39.899 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43324]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:39.899 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:39 smithi078 ceph-mon[34556]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:39.899 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:39.899 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:39 smithi078 ceph-mon[34556]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:01:39.899 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:40.196 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43327]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:01:40.196 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43327]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:40.196 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:40.196 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:01:39 smithi078 sudo[43327]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:40.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50214]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:01:40.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50214]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:40.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:40.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50214]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50584]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:01:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50584]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:40 smithi029 sudo[50584]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:41.326 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43330]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:01:41.327 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43330]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:41.327 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:41.327 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43330]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:41.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:41.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:41.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43333]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43333]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 sudo[43333]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:41.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:41.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:41.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:41.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:41.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:41.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:41.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:41.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 sudo[42296]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:01:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 sudo[42296]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 sudo[42296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:41 smithi046 sudo[42296]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:42.611 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:42.611 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:42.611 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:42.612 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:42.612 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:42.612 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:42.612 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:42 smithi029 ceph-mon[31255]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:42.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:42 smithi078 ceph-mon[34556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:42.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 sudo[42299]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:01:42.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 sudo[42299]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 sudo[42299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 sudo[42299]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:01:42.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:42 smithi046 ceph-mon[34147]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:01:43.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:43 smithi029 ceph-mon[31255]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:43.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:43 smithi078 ceph-mon[34556]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:43.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:43 smithi046 ceph-mon[34147]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:45.507 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:45 smithi029 ceph-mon[31255]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:45.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:45 smithi078 ceph-mon[34556]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:45.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:45 smithi046 ceph-mon[34147]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:01:46.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:46.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:01:46.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:46.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:01:46.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:47.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:47 smithi029 ceph-mon[31255]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-19T07:01:47.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:47 smithi029 ceph-mon[31255]: Deploying daemon osd.3 on smithi029 2024-09-19T07:01:47.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:47 smithi078 ceph-mon[34556]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-19T07:01:47.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:47 smithi078 ceph-mon[34556]: Deploying daemon osd.3 on smithi029 2024-09-19T07:01:47.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:47 smithi046 ceph-mon[34147]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-19T07:01:47.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:47 smithi046 ceph-mon[34147]: Deploying daemon osd.3 on smithi029 2024-09-19T07:01:49.590 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:49 smithi029 ceph-mon[31255]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-19T07:01:49.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:49 smithi078 ceph-mon[34556]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-19T07:01:49.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:49 smithi046 ceph-mon[34147]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-19T07:01:51.489 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:51 smithi029 ceph-mon[31255]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-19T07:01:51.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:51 smithi078 ceph-mon[34556]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-19T07:01:51.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:51 smithi046 ceph-mon[34147]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-19T07:01:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:53 smithi029 ceph-mon[31255]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:53.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:53 smithi078 ceph-mon[34556]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:53.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:53 smithi046 ceph-mon[34147]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:53.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:53.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:53.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:55.380 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:55 smithi029 ceph-mon[31255]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:55.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:55 smithi078 ceph-mon[34556]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:55 smithi046 ceph-mon[34147]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:56 smithi029 ceph-mon[31255]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:57.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:56 smithi078 ceph-mon[34556]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:57.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:57.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:57.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:56 smithi046 ceph-mon[34147]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-19T07:01:57.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:01:57.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:01:57.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:57.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.225+0000 7f9638ff9640 1 -- 172.21.15.29:0/3210485017 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f963c062630 con 0x7f96280a31b0 2024-09-19T07:01:57.226 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 3 on host 'smithi029' 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96280a31b0 msgr2=0x7f96280a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96280a31b0 0x7f96280a5670 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9624006010 tx=0x7f9624000bc0 comp rx=0 tx=0).stop 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 msgr2=0x7f963c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 0x7f963c075f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f962c00ea80 tx=0x7f962c00ef40 comp rx=0 tx=0).stop 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 shutdown_connections 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96280a31b0 0x7f96280a5670 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f963c1037c0 0x7f963c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f963c102e00 0x7f963c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:57.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 --2- 172.21.15.29:0/3210485017 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f963c101c00 0x7f963c075f90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:57.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 >> 172.21.15.29:0/3210485017 conn(0x7f963c0fd390 msgr2=0x7f963c106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:57.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 shutdown_connections 2024-09-19T07:01:57.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:01:57.228+0000 7f9641b5e640 1 -- 172.21.15.29:0/3210485017 wait complete. 2024-09-19T07:01:57.916 DEBUG:teuthology.orchestra.run.smithi029:osd.3> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T07:01:57.919 INFO:tasks.cephadm:Deploying osd.4 on smithi046 with /dev/vg_nvme/lv_3... 2024-09-19T07:01:57.919 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:01:58.183 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:01:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:57 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:57 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:57 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:57 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:57 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:57 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:58.244 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:57 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:01:58.244 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:57 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:58.244 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:57 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:01:59.246 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:59 smithi029 ceph-mon[31255]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:59.246 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:59 smithi029 ceph-mon[31255]: from='osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:01:59.247 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:01:59 smithi029 ceph-mon[31255]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:01:59.247 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:01:58 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:01:58.979+0000 7ff626679640 -1 osd.3 0 log_to_monitors true 2024-09-19T07:01:59.638 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:59 smithi046 ceph-mon[34147]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:59.638 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:59 smithi046 ceph-mon[34147]: from='osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:01:59.639 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:01:59 smithi046 ceph-mon[34147]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:01:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:59 smithi078 ceph-mon[34556]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:01:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:59 smithi078 ceph-mon[34556]: from='osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:01:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:01:59 smithi078 ceph-mon[34556]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:02:00.491 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:00 smithi046 ceph-mon[34147]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:02:00.491 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:00 smithi046 ceph-mon[34147]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:02:00.491 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:00 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:00.491 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:00 smithi046 ceph-mon[34147]: from='osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:02:00.491 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:00 smithi046 ceph-mon[34147]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:02:00.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-mon[31255]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:02:00.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-mon[31255]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:02:00.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:00.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-mon[31255]: from='osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:02:00.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-mon[31255]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:02:00.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:00 smithi078 ceph-mon[34556]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:02:00.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:00 smithi078 ceph-mon[34556]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:02:00.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:00 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:00.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:00 smithi078 ceph-mon[34556]: from='osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:02:00.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:00 smithi078 ceph-mon[34556]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:02:00.988 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:02:00.744+0000 7ff6225fc640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T07:02:00.988 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:02:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:02:00.751+0000 7ff61a41c640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:02:01.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T07:02:01.107 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-09-19T07:02:01.365 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:02:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:02:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:02:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T07:02:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='osd.3 ' entity='osd.3' 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:01.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:02:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:02:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='osd.3 ' entity='osd.3' 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:01.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='osd.3 ' entity='osd.3' 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:01.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:01.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:01.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:01.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 -- 172.21.15.46:0/828392679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b14101d10 msgr2=0x7f9b14102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 --2- 172.21.15.46:0/828392679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b14101d10 0x7f9b14102190 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009900 tx=0x7f9b0402a410 comp rx=0 tx=0).stop 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 -- 172.21.15.46:0/828392679 shutdown_connections 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 --2- 172.21.15.46:0/828392679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b141026d0 0x7f9b14108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 --2- 172.21.15.46:0/828392679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b14101d10 0x7f9b14102190 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 --2- 172.21.15.46:0/828392679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b14100b10 0x7f9b14100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 -- 172.21.15.46:0/828392679 >> 172.21.15.46:0/828392679 conn(0x7f9b140fc2a0 msgr2=0x7f9b140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 -- 172.21.15.46:0/828392679 shutdown_connections 2024-09-19T07:02:01.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 -- 172.21.15.46:0/828392679 wait complete. 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.980+0000 7f9b1b940640 1 Processor -- start 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 -- start start 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b14100b10 0x7f9b14197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b14101d10 0x7f9b14198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 0x7f9b1419f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1410d770 con 0x7f9b14101d10 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1410d5f0 con 0x7f9b141026d0 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b1b940640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1410d8f0 con 0x7f9b14100b10 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 0x7f9b1419f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 0x7f9b1419f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37534/0 (socket says 172.21.15.46:37534) 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 -- 172.21.15.46:0/1306939429 learned_addr learned my addr 172.21.15.46:0/1306939429 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b196dc640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b14100b10 0x7f9b14197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:02.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 -- 172.21.15.46:0/1306939429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b14100b10 msgr2=0x7f9b14197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b14100b10 0x7f9b14197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 -- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b14101d10 msgr2=0x7f9b14198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b18edb640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b14101d10 0x7f9b14198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b14101d10 0x7f9b14198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 -- 172.21.15.46:0/1306939429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1419fa50 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b19edd640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 0x7f9b1419f3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009fd0 tx=0x7f9b0c00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c017070 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.981+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9b0c003e20 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.982+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1419fd40 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.982+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c010460 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.982+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b141a01d0 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.983+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14107fb0 con 0x7f9b141026d0 2024-09-19T07:02:02.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.984+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9b0c003970 con 0x7f9b141026d0 2024-09-19T07:02:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.984+0000 7f9b0a7fc640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9b000a3270 0x7f9b000a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.985+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3698+0+0 (secure 0 0 0) 0x7f9b0c0ce550 con 0x7f9b141026d0 2024-09-19T07:02:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.985+0000 7f9b196dc640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9b000a3270 0x7f9b000a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.985+0000 7f9b196dc640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9b000a3270 0x7f9b000a5730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b10005db0 tx=0x7f9b10005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:02.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:01.988+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b0c09c470 con 0x7f9b141026d0 2024-09-19T07:02:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:02.175+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9b14062630 con 0x7f9b000a3270 2024-09-19T07:02:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:02:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:02:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi029 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi029 to 8546M 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] boot 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:02.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:02.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:02:02.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:02:02.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi029 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi029 to 8546M 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] boot 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:02.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:02.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi029 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi029 to 8546M 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: osd.3 [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] boot 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:02.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:03 smithi029 ceph-mon[31255]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:03 smithi029 ceph-mon[31255]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:03 smithi029 ceph-mon[31255]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T07:02:03.626 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:03 smithi046 ceph-mon[34147]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:03.626 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:03 smithi046 ceph-mon[34147]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:03.626 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:03 smithi046 ceph-mon[34147]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T07:02:03.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:03 smithi078 ceph-mon[34556]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:03.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:03 smithi078 ceph-mon[34556]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:03.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:03 smithi078 ceph-mon[34556]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T07:02:04.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:04 smithi029 ceph-mon[31255]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T07:02:04.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:04 smithi078 ceph-mon[34556]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T07:02:04.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:04 smithi046 ceph-mon[34147]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T07:02:05.627 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:05.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T07:02:05.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/3793805976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]: dispatch 2024-09-19T07:02:05.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]: dispatch 2024-09-19T07:02:05.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]': finished 2024-09-19T07:02:05.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:02:05.629 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:05.629 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:05 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/1266241579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:05.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:05.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T07:02:05.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/3793805976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]: dispatch 2024-09-19T07:02:05.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]: dispatch 2024-09-19T07:02:05.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]': finished 2024-09-19T07:02:05.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:02:05.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:05.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:05 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/1266241579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:05.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:05.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T07:02:05.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/3793805976' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]: dispatch 2024-09-19T07:02:05.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]: dispatch 2024-09-19T07:02:05.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a3fe9f3-e212-42a4-b3c0-06cc2e50c622"}]': finished 2024-09-19T07:02:05.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:02:05.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:05.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:05 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/1266241579' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:07.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:07 smithi029 ceph-mon[31255]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:02:07.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:07 smithi078 ceph-mon[34556]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:02:07.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:07 smithi046 ceph-mon[34147]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T07:02:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:09 smithi029 ceph-mon[31255]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T07:02:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:09 smithi078 ceph-mon[34556]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T07:02:09.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:09 smithi046 ceph-mon[34147]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T07:02:11.524 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:11 smithi046 ceph-mon[34147]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T07:02:11.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:11 smithi029 ceph-mon[31255]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T07:02:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:11 smithi078 ceph-mon[34556]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T07:02:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:13 smithi029 ceph-mon[31255]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:02:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:02:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:13.636 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:13 smithi046 ceph-mon[34147]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:02:13.636 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:02:13.636 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:13.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:13 smithi078 ceph-mon[34556]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:02:13.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:02:13.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:14.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:14 smithi029 ceph-mon[31255]: Deploying daemon osd.4 on smithi046 2024-09-19T07:02:14.682 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:14 smithi046 ceph-mon[34147]: Deploying daemon osd.4 on smithi046 2024-09-19T07:02:14.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:14 smithi078 ceph-mon[34556]: Deploying daemon osd.4 on smithi046 2024-09-19T07:02:15.612 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:15 smithi046 ceph-mon[34147]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:02:15.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:15 smithi029 ceph-mon[31255]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:02:15.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:15 smithi078 ceph-mon[34556]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:02:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:17 smithi029 ceph-mon[31255]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:17 smithi078 ceph-mon[34556]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:17 smithi046 ceph-mon[34147]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:19.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:19 smithi046 ceph-mon[34147]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:19 smithi029 ceph-mon[31255]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:19 smithi078 ceph-mon[34556]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:20.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:20.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:20.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:20.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:20.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:20.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:20.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:20.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:20.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:21.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:21 smithi046 ceph-mon[34147]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:21 smithi078 ceph-mon[34556]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:21.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:21 smithi029 ceph-mon[31255]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:23.222 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:23 smithi046 ceph-mon[34147]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:23.222 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.222 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.223 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:23.223 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:23.223 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:23 smithi029 ceph-mon[31255]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:23 smithi078 ceph-mon[34556]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:23.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.557+0000 7f9b0a7fc640 1 -- 172.21.15.46:0/1306939429 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9b14062630 con 0x7f9b000a3270 2024-09-19T07:02:23.559 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 4 on host 'smithi046' 2024-09-19T07:02:23.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9b000a3270 msgr2=0x7f9b000a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:23.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9b000a3270 0x7f9b000a5730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b10005db0 tx=0x7f9b10005d40 comp rx=0 tx=0).stop 2024-09-19T07:02:23.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 msgr2=0x7f9b1419f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:23.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 0x7f9b1419f3e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009fd0 tx=0x7f9b0c00b260 comp rx=0 tx=0).stop 2024-09-19T07:02:23.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 shutdown_connections 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b141026d0 0x7f9b1419f3e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b14101d10 0x7f9b14198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9b000a3270 0x7f9b000a5730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 --2- 172.21.15.46:0/1306939429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b14100b10 0x7f9b14197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 >> 172.21.15.46:0/1306939429 conn(0x7f9b140fc2a0 msgr2=0x7f9b14105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 shutdown_connections 2024-09-19T07:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:02:23.560+0000 7f9b1b940640 1 -- 172.21.15.46:0/1306939429 wait complete. 2024-09-19T07:02:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:24 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:24 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:24 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:24.273 DEBUG:teuthology.orchestra.run.smithi046:osd.4> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T07:02:24.276 INFO:tasks.cephadm:Deploying osd.5 on smithi078 with /dev/vg_nvme/lv_3... 2024-09-19T07:02:24.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:02:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:24 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:24 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:24 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:24.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:24 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:24.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:24 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:24.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:24 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:24.540 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:02:25.225 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:02:24 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:02:24.962+0000 7fc06eaec640 -1 osd.4 0 log_to_monitors true 2024-09-19T07:02:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:25 smithi046 ceph-mon[34147]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:25 smithi046 ceph-mon[34147]: from='osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:02:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:25 smithi046 ceph-mon[34147]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:02:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:25 smithi029 ceph-mon[31255]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:25 smithi029 ceph-mon[31255]: from='osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:02:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:25 smithi029 ceph-mon[31255]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:02:25.915 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:25 smithi078 ceph-mon[34556]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:25.915 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:25 smithi078 ceph-mon[34556]: from='osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:02:25.915 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:25 smithi078 ceph-mon[34556]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:02:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:02:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: from='osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:02:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T07:02:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:02:26.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:02:26.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T07:02:26.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: from='osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T07:02:26.783 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: from='osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T07:02:26.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:27.112 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T07:02:27.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_3 2024-09-19T07:02:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:02:27.475 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:02:27.089+0000 7fc06b283640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T07:02:27.475 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:02:27.096+0000 7fc06288f640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:02:27.721 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:27.721 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:27.721 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='osd.4 ' entity='osd.4' 2024-09-19T07:02:27.721 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.722 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='osd.4 ' entity='osd.4' 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:27.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:27.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 -- 172.21.15.78:0/2968865288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 msgr2=0x7fc25810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/2968865288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25810a050 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc250009ca0 tx=0x7fc25002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 -- 172.21.15.78:0/2968865288 shutdown_connections 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/2968865288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25810a050 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/2968865288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc258102e00 0x7fc258103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/2968865288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc258101c00 0x7fc258102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 -- 172.21.15.78:0/2968865288 >> 172.21.15.78:0/2968865288 conn(0x7fc2580fd390 msgr2=0x7fc2580ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 -- 172.21.15.78:0/2968865288 shutdown_connections 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.893+0000 7fc25ef7b640 1 -- 172.21.15.78:0/2968865288 wait complete. 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 Processor -- start 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 -- start start 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc258101c00 0x7fc258197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc258102e00 0x7fc258198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:27.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25819f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc25810d730 con 0x7fc258102e00 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc25810d5b0 con 0x7fc258101c00 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25ef7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc25810d8b0 con 0x7fc2581037c0 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25d518640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25819f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25d518640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25819f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49128/0 (socket says 172.21.15.78:49128) 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25d518640 1 -- 172.21.15.78:0/1963692561 learned_addr learned my addr 172.21.15.78:0/1963692561 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc257fff640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc258102e00 0x7fc258198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.894+0000 7fc25cd17640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc258101c00 0x7fc258197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25d518640 1 -- 172.21.15.78:0/1963692561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc258101c00 msgr2=0x7fc258197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25d518640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc258101c00 0x7fc258197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:27.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25d518640 1 -- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc258102e00 msgr2=0x7fc258198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25d518640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc258102e00 0x7fc258198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25d518640 1 -- 172.21.15.78:0/1963692561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25819f960 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25d518640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25819f2f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc250009dc0 tx=0x7fc250003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250032ec0 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25819fbf0 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc2500044f0 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250030d40 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.895+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2581a0130 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.896+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc258108f80 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.897+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc250004040 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.898+0000 7fc255ffb640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc2480a3410 0x7fc2480a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.898+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7fc2500efc60 con 0x7fc2581037c0 2024-09-19T07:02:27.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.898+0000 7fc25cd17640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc2480a3410 0x7fc2480a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:27.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.899+0000 7fc25cd17640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc2480a3410 0x7fc2480a58d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc24c005fd0 tx=0x7fc24c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:27.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:27.902+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2500bdb10 con 0x7fc2581037c0 2024-09-19T07:02:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='osd.4 ' entity='osd.4' 2024-09-19T07:02:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:27.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:28.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:28.076+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc258062630 con 0x7fc2480a3410 2024-09-19T07:02:28.740 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:02:28.740 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:02:28.740 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi046 2024-09-19T07:02:28.740 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-19T07:02:28.740 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:28.741 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:28.741 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:28.741 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] boot 2024-09-19T07:02:28.741 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T07:02:28.741 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:02:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:02:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi046 2024-09-19T07:02:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-19T07:02:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:28.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:28.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] boot 2024-09-19T07:02:28.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T07:02:28.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:28.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi046 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: osd.4 [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] boot 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T07:02:28.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:02:29.620 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:29 smithi078 ceph-mon[34556]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:29.620 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:29 smithi078 ceph-mon[34556]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:29 smithi029 ceph-mon[31255]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:29 smithi029 ceph-mon[31255]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:29 smithi046 ceph-mon[34147]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:02:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:29 smithi046 ceph-mon[34147]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:30 smithi029 ceph-mon[31255]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T07:02:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:30 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/1459017579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]: dispatch 2024-09-19T07:02:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:30 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]: dispatch 2024-09-19T07:02:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:30 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]': finished 2024-09-19T07:02:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:30 smithi029 ceph-mon[31255]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T07:02:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:30.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:30 smithi078 ceph-mon[34556]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T07:02:30.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:30 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/1459017579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]: dispatch 2024-09-19T07:02:30.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:30 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]: dispatch 2024-09-19T07:02:30.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:30 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]': finished 2024-09-19T07:02:30.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:30 smithi078 ceph-mon[34556]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T07:02:30.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:30 smithi046 ceph-mon[34147]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T07:02:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:30 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/1459017579' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]: dispatch 2024-09-19T07:02:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:30 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]: dispatch 2024-09-19T07:02:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:30 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb3d9461-1e47-4e1d-be8e-583f94501d3e"}]': finished 2024-09-19T07:02:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:30 smithi046 ceph-mon[34147]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T07:02:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:31.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:31 smithi029 ceph-mon[31255]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:31.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:31 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/1891226492' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:31.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:31 smithi078 ceph-mon[34556]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:31.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:31 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/1891226492' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:31 smithi046 ceph-mon[34147]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:31 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/1891226492' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:33.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:33 smithi029 ceph-mon[31255]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:33 smithi078 ceph-mon[34556]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:33 smithi046 ceph-mon[34147]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 167 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:35 smithi029 ceph-mon[31255]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:35 smithi078 ceph-mon[34556]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:35 smithi046 ceph-mon[34147]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:37 smithi078 ceph-mon[34556]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:37.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:37 smithi029 ceph-mon[31255]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:37 smithi046 ceph-mon[34147]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:38.775 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:38 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:02:38.775 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:38 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:38.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:38 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:02:38.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:38 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:38.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:38 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:02:38.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:38 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:39.826 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:39 smithi078 ceph-mon[34556]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:39.826 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:39 smithi078 ceph-mon[34556]: Deploying daemon osd.5 on smithi078 2024-09-19T07:02:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:39 smithi029 ceph-mon[31255]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:39 smithi029 ceph-mon[31255]: Deploying daemon osd.5 on smithi078 2024-09-19T07:02:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:39 smithi046 ceph-mon[34147]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:39 smithi046 ceph-mon[34147]: Deploying daemon osd.5 on smithi078 2024-09-19T07:02:41.836 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:41 smithi078 ceph-mon[34556]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:41 smithi029 ceph-mon[31255]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:41 smithi046 ceph-mon[34147]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:43 smithi029 ceph-mon[31255]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:43.924 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:43 smithi078 ceph-mon[34556]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:43 smithi046 ceph-mon[34147]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:44.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:44.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:44.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:44.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:44.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:44.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:45.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:45 smithi029 ceph-mon[31255]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:45 smithi078 ceph-mon[34556]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:45 smithi046 ceph-mon[34147]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:47 smithi029 ceph-mon[31255]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:47 smithi078 ceph-mon[34556]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:47.900 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:47.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:47 smithi046 ceph-mon[34147]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:48.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.493+0000 7fc255ffb640 1 -- 172.21.15.78:0/1963692561 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc258062630 con 0x7fc2480a3410 2024-09-19T07:02:48.495 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 5 on host 'smithi078' 2024-09-19T07:02:48.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc2480a3410 msgr2=0x7fc2480a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:48.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc2480a3410 0x7fc2480a58d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc24c005fd0 tx=0x7fc24c00b390 comp rx=0 tx=0).stop 2024-09-19T07:02:48.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 msgr2=0x7fc25819f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:48.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25819f2f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc250009dc0 tx=0x7fc250003ba0 comp rx=0 tx=0).stop 2024-09-19T07:02:48.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 shutdown_connections 2024-09-19T07:02:48.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc2480a3410 0x7fc2480a58d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:48.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2581037c0 0x7fc25819f2f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:48.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc258102e00 0x7fc258198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:48.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 --2- 172.21.15.78:0/1963692561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc258101c00 0x7fc258197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:48.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 >> 172.21.15.78:0/1963692561 conn(0x7fc2580fd390 msgr2=0x7fc258106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:48.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 shutdown_connections 2024-09-19T07:02:48.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:02:48.496+0000 7fc25ef7b640 1 -- 172.21.15.78:0/1963692561 wait complete. 2024-09-19T07:02:48.832 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:48 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:48.832 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:48 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:48.832 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:48 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:48 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:48 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:48.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:48 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:48.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:48 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:02:48.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:48 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:48.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:48 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:49.135 DEBUG:teuthology.orchestra.run.smithi078:osd.5> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T07:02:49.138 INFO:tasks.cephadm:Deploying osd.6 on smithi029 with /dev/vg_nvme/lv_2... 2024-09-19T07:02:49.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:02:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:49.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:49 smithi029 ceph-mon[31255]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:49 smithi078 ceph-mon[34556]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:49 smithi046 ceph-mon[34147]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:50.946 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:02:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:02:50.815+0000 7fcc84888640 -1 osd.5 0 log_to_monitors true 2024-09-19T07:02:51.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:51 smithi078 ceph-mon[34556]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:51.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:51 smithi078 ceph-mon[34556]: from='osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:02:51.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:51 smithi078 ceph-mon[34556]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:02:51.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:51 smithi029 ceph-mon[31255]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:51.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:51 smithi029 ceph-mon[31255]: from='osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:02:51.732 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:51 smithi029 ceph-mon[31255]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:02:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:51 smithi046 ceph-mon[34147]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:51 smithi046 ceph-mon[34147]: from='osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:02:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:51 smithi046 ceph-mon[34147]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:02:52.054 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:02:52.089 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi029:vg_nvme/lv_2 2024-09-19T07:02:52.350 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:02:52.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:02:52.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T07:02:52.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:52.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:02:52.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:52.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/4010722614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 msgr2=0x7fbf64109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/4010722614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf64109d30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009ca0 tx=0x7fbf5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/4010722614 shutdown_connections 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/4010722614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf64109d30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/4010722614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf64105010 0x7fbf64107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/4010722614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf641026e0 0x7fbf64104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/4010722614 >> 172.21.15.29:0/4010722614 conn(0x7fbf640fc280 msgr2=0x7fbf640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/4010722614 shutdown_connections 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/4010722614 wait complete. 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 Processor -- start 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.878+0000 7fbf6c3e8640 1 -- start start 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf641026e0 0x7fbf64197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf64105010 0x7fbf64198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf6419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6410d730 con 0x7fbf64107940 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6410d5b0 con 0x7fbf64105010 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6410d8b0 con 0x7fbf641026e0 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf6419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:52.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf6419f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46654/0 (socket says 172.21.15.29:46654) 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 -- 172.21.15.29:0/3596428101 learned_addr learned my addr 172.21.15.29:0/3596428101 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a184640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf641026e0 0x7fbf64197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf69983640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf64105010 0x7fbf64198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 -- 172.21.15.29:0/3596428101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf641026e0 msgr2=0x7fbf64197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf641026e0 0x7fbf64197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 -- 172.21.15.29:0/3596428101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf64105010 msgr2=0x7fbf64198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf64105010 0x7fbf64198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 -- 172.21.15.29:0/3596428101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6419fa40 con 0x7fbf64107940 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6a985640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf6419f3d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009dc0 tx=0x7fbf5c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c032ec0 con 0x7fbf64107940 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6419fcd0 con 0x7fbf64107940 2024-09-19T07:02:52.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf5c0044f0 con 0x7fbf64107940 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c030d40 con 0x7fbf64107940 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.879+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf641a01c0 con 0x7fbf64107940 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.881+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf640fdd70 con 0x7fbf64107940 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.882+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbf5c004040 con 0x7fbf64107940 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.882+0000 7fbf577fe640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf500a3410 0x7fbf500a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.883+0000 7fbf6a184640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf500a3410 0x7fbf500a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.883+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7fbf5c0f0130 con 0x7fbf64107940 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.883+0000 7fbf6a184640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf500a3410 0x7fbf500a58d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005d00 tx=0x7fbf5800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:52.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:52.886+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf5c0bdd90 con 0x7fbf64107940 2024-09-19T07:02:52.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:02:52.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:52.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:52.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:02:52.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:52.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:52.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:02:52.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:02:53.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:02:53.075+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbf64062630 con 0x7fbf500a3410 2024-09-19T07:02:53.643 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:02:53.312+0000 7fcc8080b640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T07:02:53.643 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:02:53.317+0000 7fcc7862b640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:02:53.742 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi078 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi078 to 8544M 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:53.743 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:53 smithi029 ceph-mon[31255]: from='osd.5 ' entity='osd.5' 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi078 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi078 to 8544M 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:53.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:53 smithi078 ceph-mon[34556]: from='osd.5 ' entity='osd.5' 2024-09-19T07:02:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi078 2024-09-19T07:02:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi078 to 8544M 2024-09-19T07:02:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:02:53.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:53 smithi046 ceph-mon[34147]: from='osd.5 ' entity='osd.5' 2024-09-19T07:02:54.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:54 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:02:54.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:54 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:02:54.797 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:54 smithi029 ceph-mon[31255]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:54.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:54 smithi029 ceph-mon[31255]: osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] boot 2024-09-19T07:02:54.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:54 smithi029 ceph-mon[31255]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T07:02:54.798 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:54 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:54.901 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:54 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:02:54.901 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:54 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:02:54.901 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:54 smithi046 ceph-mon[34147]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:54.902 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:54 smithi046 ceph-mon[34147]: osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] boot 2024-09-19T07:02:54.902 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:54 smithi046 ceph-mon[34147]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T07:02:54.902 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:54 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:54.911 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:54 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:02:54.911 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:54 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:02:54.911 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:54 smithi078 ceph-mon[34556]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:54.911 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:54 smithi078 ceph-mon[34556]: osd.5 [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] boot 2024-09-19T07:02:54.911 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:54 smithi078 ceph-mon[34556]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T07:02:54.911 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:54 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3401098914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]: dispatch 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]: dispatch 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]': finished 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:02:55.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3401098914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]: dispatch 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]: dispatch 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]': finished 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:02:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3401098914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]: dispatch 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]: dispatch 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd"}]': finished 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:02:56.096 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:56.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:56 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1491935150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:56.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:56 smithi078 ceph-mon[34556]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:02:56.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:56.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:56 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1491935150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:56.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:56 smithi046 ceph-mon[34147]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:02:56.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:56 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1491935150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:02:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:56 smithi029 ceph-mon[31255]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:02:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:57.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:57 smithi078 ceph-mon[34556]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:02:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:57 smithi078 ceph-mon[34556]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T07:02:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:57 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:57 smithi046 ceph-mon[34147]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:02:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:57 smithi046 ceph-mon[34147]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T07:02:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:57 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:57 smithi029 ceph-mon[31255]: pgmap v140: 1 pgs: 1 remapped+peering; 577 KiB data, 198 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:02:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:57 smithi029 ceph-mon[31255]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T07:02:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:57 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:02:59.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:02:59 smithi078 ceph-mon[34556]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:02:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:02:59 smithi046 ceph-mon[34147]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:00.104 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:02:59 smithi029 ceph-mon[31255]: pgmap v143: 1 pgs: 1 remapped+peering; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:01.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:01 smithi078 ceph-mon[34556]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T07:03:01.951 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:01 smithi029 ceph-mon[31255]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T07:03:01.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:01 smithi046 ceph-mon[34147]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T07:03:03.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:03 smithi078 ceph-mon[34556]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T07:03:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:03 smithi046 ceph-mon[34147]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T07:03:04.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:03 smithi029 ceph-mon[31255]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-19T07:03:04.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:03:04.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:04.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:03:04.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:05.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:03:05.003 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:05.772 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:05 smithi029 ceph-mon[31255]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:03:05.772 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:05 smithi029 ceph-mon[31255]: Deploying daemon osd.6 on smithi029 2024-09-19T07:03:05.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:05 smithi078 ceph-mon[34556]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:03:05.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:05 smithi078 ceph-mon[34556]: Deploying daemon osd.6 on smithi029 2024-09-19T07:03:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:05 smithi046 ceph-mon[34147]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:03:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:05 smithi046 ceph-mon[34147]: Deploying daemon osd.6 on smithi029 2024-09-19T07:03:07.857 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:07 smithi029 ceph-mon[31255]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:03:07.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:07 smithi078 ceph-mon[34556]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:03:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:07 smithi046 ceph-mon[34147]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:03:09.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:09 smithi078 ceph-mon[34556]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T07:03:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:09 smithi046 ceph-mon[34147]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T07:03:10.035 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:09 smithi029 ceph-mon[31255]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T07:03:10.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:10.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:10.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:10.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:10.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:10.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:11.120 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:11.120 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:11.120 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:11.814 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:11 smithi029 ceph-mon[31255]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:03:11.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:11 smithi078 ceph-mon[34556]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:03:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:11 smithi046 ceph-mon[34147]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:03:13.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:13 smithi029 ceph-mon[31255]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:13.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:13 smithi078 ceph-mon[34556]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:13 smithi046 ceph-mon[34147]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:14.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.254+0000 7fbf577fe640 1 -- 172.21.15.29:0/3596428101 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbf64062630 con 0x7fbf500a3410 2024-09-19T07:03:14.257 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 6 on host 'smithi029' 2024-09-19T07:03:14.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf500a3410 msgr2=0x7fbf500a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf500a3410 0x7fbf500a58d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005d00 tx=0x7fbf5800b410 comp rx=0 tx=0).stop 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 msgr2=0x7fbf6419f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf6419f3d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009dc0 tx=0x7fbf5c003ba0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 shutdown_connections 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf64107940 0x7fbf6419f3d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf64105010 0x7fbf64198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf500a3410 0x7fbf500a58d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 --2- 172.21.15.29:0/3596428101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf641026e0 0x7fbf64197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 >> 172.21.15.29:0/3596428101 conn(0x7fbf640fc280 msgr2=0x7fbf64103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 shutdown_connections 2024-09-19T07:03:14.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:03:14.257+0000 7fbf6c3e8640 1 -- 172.21.15.29:0/3596428101 wait complete. 2024-09-19T07:03:14.970 DEBUG:teuthology.orchestra.run.smithi029:osd.6> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T07:03:14.972 INFO:tasks.cephadm:Deploying osd.7 on smithi046 with /dev/vg_nvme/lv_2... 2024-09-19T07:03:14.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:03:15.238 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:03:15.251 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:15 smithi046 ceph-mon[34147]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:15.251 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.252 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.507 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.507 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.544 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:15 smithi029 ceph-mon[31255]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:15.545 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.545 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.545 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.545 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:15 smithi078 ceph-mon[34556]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:15.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:15.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:16.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:16 smithi046 ceph-mon[34147]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:03:16.502 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:16 smithi029 ceph-mon[31255]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:03:16.502 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:03:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:03:16.242+0000 7f3bc8918640 -1 osd.6 0 log_to_monitors true 2024-09-19T07:03:16.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:16 smithi078 ceph-mon[34556]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:03:17.355 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:17 smithi046 ceph-mon[34147]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:17.356 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:17 smithi046 ceph-mon[34147]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:03:17.356 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:17 smithi046 ceph-mon[34147]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T07:03:17.356 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:17 smithi046 ceph-mon[34147]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:03:17.356 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:17 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:17.624 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:03:17.261+0000 7f3bc489b640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T07:03:17.624 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:03:17.273+0000 7f3bc06c3640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:03:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-mon[31255]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-mon[31255]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:03:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-mon[31255]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T07:03:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-mon[31255]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:03:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:17 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:17 smithi078 ceph-mon[34556]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:17 smithi078 ceph-mon[34556]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:03:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:17 smithi078 ceph-mon[34556]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T07:03:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:17 smithi078 ceph-mon[34556]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:03:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:17 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T07:03:18.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-09-19T07:03:18.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:03:18.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T07:03:18.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:18.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.465 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:03:18.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:03:18.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:18.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:18.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:18.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:18.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 -- 172.21.15.46:0/586334518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 msgr2=0x7f86f4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:18.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 --2- 172.21.15.46:0/586334518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f4103280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009900 tx=0x7f86e002a3f0 comp rx=0 tx=0).stop 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 -- 172.21.15.46:0/586334518 shutdown_connections 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 --2- 172.21.15.46:0/586334518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86f41037c0 0x7f86f410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 --2- 172.21.15.46:0/586334518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f4103280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 --2- 172.21.15.46:0/586334518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 0x7f86f4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 -- 172.21.15.46:0/586334518 >> 172.21.15.46:0/586334518 conn(0x7f86f40fd390 msgr2=0x7f86f40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 -- 172.21.15.46:0/586334518 shutdown_connections 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.960+0000 7f86fb049640 1 -- 172.21.15.46:0/586334518 wait complete. 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 Processor -- start 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 -- start start 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 0x7f86f4075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:18.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86f41037c0 0x7f86f4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f86f410d730 con 0x7f86f4101c00 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f86f410d5b0 con 0x7f86f4102e00 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86fb049640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86f410d8b0 con 0x7f86f41037c0 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f40745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40924/0 (socket says 172.21.15.46:40924) 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 -- 172.21.15.46:0/3504380196 learned_addr learned my addr 172.21.15.46:0/3504380196 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f95e6640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86f41037c0 0x7f86f4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f8de5640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 0x7f86f4075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 -- 172.21.15.46:0/3504380196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86f41037c0 msgr2=0x7f86f4074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86f41037c0 0x7f86f4074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 -- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 msgr2=0x7f86f4075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:18.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 0x7f86f4075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f3fff640 1 -- 172.21.15.46:0/3504380196 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f40753e0 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.961+0000 7f86f8de5640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 0x7f86f4075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.962+0000 7f86f3fff640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f40745e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86e0005940 tx=0x7f86e00042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.962+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e003f030 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.962+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86e0003cb0 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.962+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f41a1eb0 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.962+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0035070 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.962+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f41a22a0 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.964+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f4102000 con 0x7f86f4102e00 2024-09-19T07:03:18.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.964+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f86e0042030 con 0x7f86f4102e00 2024-09-19T07:03:18.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.965+0000 7f86f1ffb640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f86e40a3240 0x7f86e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:18.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.965+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f86e00ef2e0 con 0x7f86f4102e00 2024-09-19T07:03:18.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.965+0000 7f86f8de5640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f86e40a3240 0x7f86e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:18.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.966+0000 7f86f8de5640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f86e40a3240 0x7f86e40a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86f4102c60 tx=0x7f86e8005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:18.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:18.969+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86e00bcc70 con 0x7f86f4102e00 2024-09-19T07:03:19.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:19.154+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f86f4062630 con 0x7f86e40a3240 2024-09-19T07:03:19.478 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:03:19.478 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:03:19.478 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:19.478 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi029 2024-09-19T07:03:19.479 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi029 to 5697M 2024-09-19T07:03:19.479 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] boot 2024-09-19T07:03:19.479 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T07:03:19.479 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:19.479 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:19.479 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:19.480 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:19.480 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:19.480 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:19.480 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:19.480 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:03:19.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:03:19.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:19.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi029 2024-09-19T07:03:19.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi029 to 5697M 2024-09-19T07:03:19.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] boot 2024-09-19T07:03:19.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T07:03:19.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:19.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:19.627 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:19.627 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:19.627 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:19.627 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:19.627 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:19.628 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:03:19.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:03:19.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:03:19.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi029 2024-09-19T07:03:19.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi029 to 5697M 2024-09-19T07:03:19.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: osd.6 [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] boot 2024-09-19T07:03:19.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:19.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:20.624 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:20 smithi046 ceph-mon[34147]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:20.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:20 smithi029 ceph-mon[31255]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:20.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:20 smithi078 ceph-mon[34556]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:21 smithi029 ceph-mon[31255]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:21 smithi029 ceph-mon[31255]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T07:03:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:21 smithi078 ceph-mon[34556]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:21.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:21 smithi078 ceph-mon[34556]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T07:03:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:21 smithi046 ceph-mon[34147]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:21 smithi046 ceph-mon[34147]: osdmap e45: 7 total, 7 up, 7 in 2024-09-19T07:03:22.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:22 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/172744750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]: dispatch 2024-09-19T07:03:22.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:22 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]: dispatch 2024-09-19T07:03:22.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:22 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]': finished 2024-09-19T07:03:22.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:22 smithi029 ceph-mon[31255]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T07:03:22.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:22 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:22.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:22 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/172744750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]: dispatch 2024-09-19T07:03:22.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:22 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]: dispatch 2024-09-19T07:03:22.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:22 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]': finished 2024-09-19T07:03:22.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:22 smithi078 ceph-mon[34556]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T07:03:22.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:22 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:22.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:22 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/172744750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]: dispatch 2024-09-19T07:03:22.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:22 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]: dispatch 2024-09-19T07:03:22.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:22 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54e4494b-0f7a-42d4-a840-18a685821466"}]': finished 2024-09-19T07:03:22.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:22 smithi046 ceph-mon[34147]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T07:03:22.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:22 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:23.597 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:23 smithi078 ceph-mon[34556]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:23.597 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:23 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/2775885962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:23.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:23 smithi029 ceph-mon[31255]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:23.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:23 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/2775885962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:23.628 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:23 smithi046 ceph-mon[34147]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:23.628 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:23 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/2775885962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:25 smithi029 ceph-mon[31255]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:25 smithi078 ceph-mon[34556]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:25 smithi046 ceph-mon[34147]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:27 smithi029 ceph-mon[31255]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:27 smithi078 ceph-mon[34556]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:27 smithi046 ceph-mon[34147]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:29.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:29 smithi046 ceph-mon[34147]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:29.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:29 smithi029 ceph-mon[31255]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:29 smithi078 ceph-mon[34556]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:30.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:03:30.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:30.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:03:30.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:30.696 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:03:30.696 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:31.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:31 smithi029 ceph-mon[31255]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:31.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:31 smithi029 ceph-mon[31255]: Deploying daemon osd.7 on smithi046 2024-09-19T07:03:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:31 smithi078 ceph-mon[34556]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:31 smithi078 ceph-mon[34556]: Deploying daemon osd.7 on smithi046 2024-09-19T07:03:31.709 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:31 smithi046 ceph-mon[34147]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:31.709 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:31 smithi046 ceph-mon[34147]: Deploying daemon osd.7 on smithi046 2024-09-19T07:03:33.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:33 smithi046 ceph-mon[34147]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:33.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:33 smithi029 ceph-mon[31255]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:33.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:33 smithi078 ceph-mon[34556]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:35.372 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:35 smithi046 ceph-mon[34147]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:35.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:35 smithi029 ceph-mon[31255]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:35.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:35 smithi078 ceph-mon[34556]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:37.452 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:37 smithi046 ceph-mon[34147]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:37.452 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:37.452 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:37.453 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:37 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:37 smithi029 ceph-mon[31255]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:37 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:37 smithi078 ceph-mon[34556]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:37.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:37 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:39.355 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:39 smithi046 ceph-mon[34147]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:39.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:39 smithi029 ceph-mon[31255]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:39 smithi078 ceph-mon[34556]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:40.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.658+0000 7f86f1ffb640 1 -- 172.21.15.46:0/3504380196 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f86f4062630 con 0x7f86e40a3240 2024-09-19T07:03:40.660 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 7 on host 'smithi046' 2024-09-19T07:03:40.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.660+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f86e40a3240 msgr2=0x7f86e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.660+0000 7f86fb049640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f86e40a3240 0x7f86e40a5700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86f4102c60 tx=0x7f86e8005db0 comp rx=0 tx=0).stop 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.660+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 msgr2=0x7f86f40745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.660+0000 7f86fb049640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f40745e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86e0005940 tx=0x7f86e00042f0 comp rx=0 tx=0).stop 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 shutdown_connections 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f86e40a3240 0x7f86e40a5700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86f41037c0 0x7f86f4074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f4102e00 0x7f86f40745e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:40.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 --2- 172.21.15.46:0/3504380196 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86f4101c00 0x7f86f4075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 >> 172.21.15.46:0/3504380196 conn(0x7f86f40fd390 msgr2=0x7f86f41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 shutdown_connections 2024-09-19T07:03:40.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:03:40.661+0000 7f86fb049640 1 -- 172.21.15.46:0/3504380196 wait complete. 2024-09-19T07:03:40.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:41.232 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:41.384 DEBUG:teuthology.orchestra.run.smithi046:osd.7> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T07:03:41.386 INFO:tasks.cephadm:Deploying osd.8 on smithi078 with /dev/vg_nvme/lv_2... 2024-09-19T07:03:41.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:03:41.645 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:03:41.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:41 smithi078 ceph-mon[34556]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:41 smithi046 ceph-mon[34147]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:41 smithi029 ceph-mon[31255]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:42.975 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:03:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:03:42.738+0000 7f2c01974640 -1 osd.7 0 log_to_monitors true 2024-09-19T07:03:43.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:43 smithi078 ceph-mon[34556]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:43.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:43 smithi078 ceph-mon[34556]: from='osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:03:43.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:43 smithi078 ceph-mon[34556]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:03:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:43 smithi046 ceph-mon[34147]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:43 smithi046 ceph-mon[34147]: from='osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:03:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:43 smithi046 ceph-mon[34147]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:03:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:43 smithi029 ceph-mon[31255]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:43 smithi029 ceph-mon[31255]: from='osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:03:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:43 smithi029 ceph-mon[31255]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:03:44.215 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T07:03:44.240 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_2 2024-09-19T07:03:44.496 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:03:44.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T07:03:44.727 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:44.778 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:03:44.778 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T07:03:44.778 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T07:03:44.779 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 -- 172.21.15.78:0/3580637873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 msgr2=0x7fa490074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 --2- 172.21.15.78:0/3580637873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa490074680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa484009900 tx=0x7fa48402a410 comp rx=0 tx=0).stop 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 -- 172.21.15.78:0/3580637873 shutdown_connections 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 --2- 172.21.15.78:0/3580637873 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa490109a80 0x7fa49010bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 --2- 172.21.15.78:0/3580637873 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490074c50 0x7fa4900750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 --2- 172.21.15.78:0/3580637873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa490074680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 -- 172.21.15.78:0/3580637873 >> 172.21.15.78:0/3580637873 conn(0x7fa4900fd390 msgr2=0x7fa4900ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 -- 172.21.15.78:0/3580637873 shutdown_connections 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 -- 172.21.15.78:0/3580637873 wait complete. 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.967+0000 7fa496085640 1 Processor -- start 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 -- start start 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa490074c50 0x7fa49019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa49019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490109a80 0x7fa4901a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa49010f990 con 0x7fa490074c50 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa49010f810 con 0x7fa490109a80 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa496085640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa49010fb10 con 0x7fa490076220 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa49019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa49019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36370/0 (socket says 172.21.15.78:36370) 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 -- 172.21.15.78:0/2960067353 learned_addr learned my addr 172.21.15.78:0/2960067353 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48f7fe640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa490074c50 0x7fa49019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48ffff640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490109a80 0x7fa4901a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 -- 172.21.15.78:0/2960067353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490109a80 msgr2=0x7fa4901a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490109a80 0x7fa4901a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 -- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa490074c50 msgr2=0x7fa49019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa490074c50 0x7fa49019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 -- 172.21.15.78:0/2960067353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4901a1cd0 con 0x7fa490076220 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.968+0000 7fa48effd640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa49019a5e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d950 tx=0x7fa48000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.969+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480017030 con 0x7fa490076220 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.969+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4901a1fc0 con 0x7fa490076220 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.969+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa480004020 con 0x7fa490076220 2024-09-19T07:03:44.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.969+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4800047a0 con 0x7fa490076220 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.969+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4901a2470 con 0x7fa490076220 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.970+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490108800 con 0x7fa490076220 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.971+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa4800041d0 con 0x7fa490076220 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.971+0000 7fa48cff9640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa4780a3270 0x7fa4780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.972+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7fa4800ce680 con 0x7fa490076220 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.972+0000 7fa48f7fe640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa4780a3270 0x7fa4780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.972+0000 7fa48f7fe640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa4780a3270 0x7fa4780a5730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa484004770 tx=0x7fa484000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:44.976+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa48009c020 con 0x7fa490076220 2024-09-19T07:03:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:03:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T07:03:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:03:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:03:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T07:03:45.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:45.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:03:45.157+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa490062630 con 0x7fa4780a3270 2024-09-19T07:03:45.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:03:45.160+0000 7f2bfe10b640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T07:03:45.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:03:45.168+0000 7f2bf5717640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:03:45.794 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:45.794 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi046 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: from='osd.7 ' entity='osd.7' 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] boot 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T07:03:45.795 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi046 2024-09-19T07:03:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-19T07:03:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:45.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: from='osd.7 ' entity='osd.7' 2024-09-19T07:03:45.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:45.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:45.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] boot 2024-09-19T07:03:45.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T07:03:45.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 226 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi046 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: from='osd.7 ' entity='osd.7' 2024-09-19T07:03:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:03:46.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:46.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: osd.7 [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] boot 2024-09-19T07:03:46.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T07:03:46.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:03:46.830 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:46 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:03:46.830 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:46 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:03:46.831 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:46 smithi078 ceph-mon[34556]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:46.831 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:46 smithi078 ceph-mon[34556]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T07:03:46.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:46 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:03:46.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:46 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:03:46.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:46 smithi046 ceph-mon[34147]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:46.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:46 smithi046 ceph-mon[34147]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T07:03:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:46 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:03:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:46 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:03:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:46 smithi029 ceph-mon[31255]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:46 smithi029 ceph-mon[31255]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/3423346741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]: dispatch 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]: dispatch 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]': finished 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:03:47.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:03:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T07:03:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/3423346741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]: dispatch 2024-09-19T07:03:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]: dispatch 2024-09-19T07:03:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]': finished 2024-09-19T07:03:47.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:03:47.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:03:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T07:03:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/3423346741' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]: dispatch 2024-09-19T07:03:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]: dispatch 2024-09-19T07:03:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3f5854-9361-45b2-b1b5-5d1dc46ca568"}]': finished 2024-09-19T07:03:48.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:03:48.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:03:48.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:48 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/1527545115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:48.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:48 smithi078 ceph-mon[34556]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T07:03:48.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:48 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:03:48.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:48 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/1527545115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:48.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:48 smithi046 ceph-mon[34147]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T07:03:48.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:48 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:03:49.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:48 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/1527545115' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:03:49.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:48 smithi029 ceph-mon[31255]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T07:03:49.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:48 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:03:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:49 smithi078 ceph-mon[34556]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:49 smithi046 ceph-mon[34147]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:50.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:49 smithi029 ceph-mon[31255]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:51.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:51 smithi078 ceph-mon[34556]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:51 smithi046 ceph-mon[34147]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:52.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:51 smithi029 ceph-mon[31255]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:53 smithi078 ceph-mon[34556]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:53 smithi046 ceph-mon[34147]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:53 smithi029 ceph-mon[31255]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:55.965 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:55 smithi078 ceph-mon[34556]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:55 smithi046 ceph-mon[34147]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:56.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:55 smithi029 ceph-mon[31255]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:56.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:03:56.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:56.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:03:56.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:03:57.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:57 smithi046 ceph-mon[34147]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:57 smithi046 ceph-mon[34147]: Deploying daemon osd.8 on smithi078 2024-09-19T07:03:58.010 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:57 smithi078 ceph-mon[34556]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:58.010 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:57 smithi078 ceph-mon[34556]: Deploying daemon osd.8 on smithi078 2024-09-19T07:03:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:57 smithi029 ceph-mon[31255]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:57 smithi029 ceph-mon[31255]: Deploying daemon osd.8 on smithi078 2024-09-19T07:03:59.775 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:03:59 smithi078 ceph-mon[34556]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:03:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:03:59 smithi046 ceph-mon[34147]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:03:59 smithi029 ceph-mon[31255]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:01.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:01 smithi046 ceph-mon[34147]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:01 smithi029 ceph-mon[31255]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:01 smithi078 ceph-mon[34556]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:02.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:02.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:02.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:02 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:02 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:03.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:03.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:03.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:02 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:03 smithi046 ceph-mon[34147]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:03.984 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:03 smithi078 ceph-mon[34556]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:04.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:03 smithi029 ceph-mon[31255]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.428+0000 7fa48cff9640 1 -- 172.21.15.78:0/2960067353 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa490062630 con 0x7fa4780a3270 2024-09-19T07:04:05.430 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 8 on host 'smithi078' 2024-09-19T07:04:05.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa4780a3270 msgr2=0x7fa4780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:05.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa4780a3270 0x7fa4780a5730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa484004770 tx=0x7fa484000bc0 comp rx=0 tx=0).stop 2024-09-19T07:04:05.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 msgr2=0x7fa49019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa49019a5e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa48000d950 tx=0x7fa48000de10 comp rx=0 tx=0).stop 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 shutdown_connections 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa490109a80 0x7fa4901a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa4780a3270 0x7fa4780a5730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa490076220 0x7fa49019a5e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 --2- 172.21.15.78:0/2960067353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa490074c50 0x7fa49019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 >> 172.21.15.78:0/2960067353 conn(0x7fa4900fd390 msgr2=0x7fa4901059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 shutdown_connections 2024-09-19T07:04:05.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:04:05.430+0000 7fa496085640 1 -- 172.21.15.78:0/2960067353 wait complete. 2024-09-19T07:04:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:05.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:06.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.110 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:06.111 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:06.111 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.111 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:06.111 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.111 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:06.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:06.136 DEBUG:teuthology.orchestra.run.smithi078:osd.8> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T07:04:06.138 INFO:tasks.cephadm:Deploying osd.9 on smithi029 with /dev/vg_nvme/lv_1... 2024-09-19T07:04:06.138 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:04:06.406 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:04:07.845 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:07 smithi029 ceph-mon[31255]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:07.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:07 smithi078 ceph-mon[34556]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:07 smithi046 ceph-mon[34147]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:08.446 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:04:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:04:08.078+0000 7fc158bc1640 -1 osd.8 0 log_to_monitors true 2024-09-19T07:04:08.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:08 smithi078 ceph-mon[34556]: from='osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:04:08.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:08 smithi078 ceph-mon[34556]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:04:09.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:08 smithi029 ceph-mon[31255]: from='osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:04:09.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:08 smithi029 ceph-mon[31255]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:04:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:08 smithi046 ceph-mon[34147]: from='osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:04:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:08 smithi046 ceph-mon[34147]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:04:09.313 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:04:09.339 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi029:vg_nvme/lv_1 2024-09-19T07:04:09.594 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:04:10.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:10.010 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:10.011 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- 172.21.15.29:0/3173684424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 msgr2=0x7ff2f4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- 172.21.15.29:0/3173684424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4102190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009900 tx=0x7ff2dc02a410 comp rx=0 tx=0).stop 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- 172.21.15.29:0/3173684424 shutdown_connections 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- 172.21.15.29:0/3173684424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f41026d0 0x7ff2f4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- 172.21.15.29:0/3173684424 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4102190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- 172.21.15.29:0/3173684424 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2f4100b10 0x7ff2f4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:10.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- 172.21.15.29:0/3173684424 >> 172.21.15.29:0/3173684424 conn(0x7ff2f40fc2a0 msgr2=0x7ff2f40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- 172.21.15.29:0/3173684424 shutdown_connections 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- 172.21.15.29:0/3173684424 wait complete. 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 Processor -- start 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- start start 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2f4100b10 0x7ff2f4104c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4103290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f41026d0 0x7ff2f41037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f410c670 con 0x7ff2f4101d10 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f410c4f0 con 0x7ff2f4100b10 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.095+0000 7ff2fa044640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f410c7f0 con 0x7ff2f41026d0 2024-09-19T07:04:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4103290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4103290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46072/0 (socket says 172.21.15.29:46072) 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 -- 172.21.15.29:0/923890209 learned_addr learned my addr 172.21.15.29:0/923890209 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2f3fff640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f41026d0 0x7ff2f41037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2f37fe640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2f4100b10 0x7ff2f4104c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 -- 172.21.15.29:0/923890209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f41026d0 msgr2=0x7ff2f41037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f41026d0 0x7ff2f41037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 -- 172.21.15.29:0/923890209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2f4100b10 msgr2=0x7ff2f4104c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2f4100b10 0x7ff2f4104c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 -- 172.21.15.29:0/923890209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f4104090 con 0x7ff2f4101d10 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2ebfff640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4103290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0314e0 tx=0x7ff2dc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc03f070 con 0x7ff2f4101d10 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff2dc031c40 con 0x7ff2f4101d10 2024-09-19T07:04:10.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f41a1f40 con 0x7ff2f4101d10 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc035030 con 0x7ff2f4101d10 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.096+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f41a2330 con 0x7ff2f4101d10 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.097+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f4100f10 con 0x7ff2f4101d10 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.099+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff2dc042070 con 0x7ff2f4101d10 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.100+0000 7ff2f17fa640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2e00a3240 0x7ff2e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.100+0000 7ff2f37fe640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2e00a3240 0x7ff2e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.100+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7ff2dc0efb60 con 0x7ff2f4101d10 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.101+0000 7ff2f37fe640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2e00a3240 0x7ff2e00a5700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4101b70 tx=0x7ff2e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:10.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.104+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2dc0bcd00 con 0x7ff2f4101d10 2024-09-19T07:04:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:10.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:10.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:04:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:10.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:10.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:10.286+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff2f406aea0 con 0x7ff2e00a3240 2024-09-19T07:04:10.695 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:04:10.407+0000 7fc154b44640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T07:04:10.696 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:04:10.418+0000 7fc14c964640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:04:11.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi078 2024-09-19T07:04:11.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi078 to 5696M 2024-09-19T07:04:11.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:04:11.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T07:04:11.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:11.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:11.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:11.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:11.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:11.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:10 smithi029 ceph-mon[31255]: from='osd.8 ' entity='osd.8' 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi078 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi078 to 5696M 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:11.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:10 smithi078 ceph-mon[34556]: from='osd.8 ' entity='osd.8' 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi078 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi078 to 5696M 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:11.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:10 smithi046 ceph-mon[34147]: from='osd.8 ' entity='osd.8' 2024-09-19T07:04:12.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] boot 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:12.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:11 smithi029 ceph-mon[31255]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T07:04:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] boot 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:11 smithi078 ceph-mon[34556]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi029:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: osd.8 [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] boot 2024-09-19T07:04:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T07:04:12.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:04:12.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:11 smithi046 ceph-mon[34147]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T07:04:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:13 smithi029 ceph-mon[31255]: pgmap v196: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:13 smithi029 ceph-mon[31255]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T07:04:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:13 smithi078 ceph-mon[34556]: pgmap v196: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:13.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:13 smithi078 ceph-mon[34556]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T07:04:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:13 smithi046 ceph-mon[34147]: pgmap v196: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:13 smithi046 ceph-mon[34147]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T07:04:14.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:14 smithi029 ceph-mon[31255]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T07:04:14.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:14 smithi078 ceph-mon[34556]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T07:04:14.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:14 smithi046 ceph-mon[34147]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T07:04:15.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:15 smithi029 ceph-mon[31255]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:15.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:15 smithi029 ceph-mon[31255]: osdmap e60: 9 total, 9 up, 9 in 2024-09-19T07:04:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:15 smithi078 ceph-mon[34556]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:15.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:15 smithi078 ceph-mon[34556]: osdmap e60: 9 total, 9 up, 9 in 2024-09-19T07:04:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:15 smithi046 ceph-mon[34147]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:15 smithi046 ceph-mon[34147]: osdmap e60: 9 total, 9 up, 9 in 2024-09-19T07:04:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:17 smithi029 ceph-mon[31255]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-19T07:04:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:17 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3896602598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00"}]: dispatch 2024-09-19T07:04:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:17 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3896602598' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00"}]': finished 2024-09-19T07:04:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:17 smithi029 ceph-mon[31255]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T07:04:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:17 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:17 smithi078 ceph-mon[34556]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-19T07:04:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:17 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3896602598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00"}]: dispatch 2024-09-19T07:04:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:17 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3896602598' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00"}]': finished 2024-09-19T07:04:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:17 smithi078 ceph-mon[34556]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T07:04:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:17 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:17 smithi046 ceph-mon[34147]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 293 MiB used, 804 GiB / 805 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-19T07:04:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:17 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3896602598' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00"}]: dispatch 2024-09-19T07:04:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:17 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3896602598' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00"}]': finished 2024-09-19T07:04:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:17 smithi046 ceph-mon[34147]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T07:04:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:17 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:18.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:18 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3402435474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:18.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:18 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3402435474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:18.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:18 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3402435474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:19 smithi029 ceph-mon[31255]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T07:04:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:19 smithi078 ceph-mon[34556]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T07:04:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:19 smithi046 ceph-mon[34147]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-19T07:04:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:21 smithi029 ceph-mon[31255]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T07:04:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:21 smithi078 ceph-mon[34556]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T07:04:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:21 smithi046 ceph-mon[34147]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-19T07:04:23.621 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:23 smithi029 ceph-mon[31255]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:04:23.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:23 smithi078 ceph-mon[34556]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:04:23.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:23 smithi046 ceph-mon[34147]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:04:25.581 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:25 smithi029 ceph-mon[31255]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:04:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:25 smithi078 ceph-mon[34556]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:04:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:25 smithi046 ceph-mon[34147]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:04:26.585 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:04:26.585 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:26.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:04:26.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:04:26.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:27 smithi029 ceph-mon[31255]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:27 smithi029 ceph-mon[31255]: Deploying daemon osd.9 on smithi029 2024-09-19T07:04:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:27 smithi078 ceph-mon[34556]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:27.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:27 smithi078 ceph-mon[34556]: Deploying daemon osd.9 on smithi029 2024-09-19T07:04:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:27 smithi046 ceph-mon[34147]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:27 smithi046 ceph-mon[34147]: Deploying daemon osd.9 on smithi029 2024-09-19T07:04:29.599 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:29 smithi029 ceph-mon[31255]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:29 smithi078 ceph-mon[34556]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:29 smithi046 ceph-mon[34147]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:31.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:31 smithi029 ceph-mon[31255]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:31 smithi078 ceph-mon[34556]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:31 smithi046 ceph-mon[34147]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:32.603 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:32.603 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:32.603 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:32.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:32.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:32.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:32.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:32.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:32.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:33.604 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:33 smithi029 ceph-mon[31255]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:33.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:33 smithi078 ceph-mon[34556]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:33.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:33 smithi046 ceph-mon[34147]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:35.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:35 smithi029 ceph-mon[31255]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:35.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:35.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:35.526 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:35 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.563+0000 7ff2f17fa640 1 -- 172.21.15.29:0/923890209 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff2f406aea0 con 0x7ff2e00a3240 2024-09-19T07:04:35.564 INFO:teuthology.orchestra.run.smithi029.stdout:Created osd(s) 9 on host 'smithi029' 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2e00a3240 msgr2=0x7ff2e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2e00a3240 0x7ff2e00a5700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4101b70 tx=0x7ff2e400b390 comp rx=0 tx=0).stop 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 msgr2=0x7ff2f4103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4103290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0314e0 tx=0x7ff2dc003c10 comp rx=0 tx=0).stop 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 shutdown_connections 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2e00a3240 0x7ff2e00a5700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2f41026d0 0x7ff2f41037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2f4101d10 0x7ff2f4103290 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 --2- 172.21.15.29:0/923890209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2f4100b10 0x7ff2f4104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:35.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 >> 172.21.15.29:0/923890209 conn(0x7ff2f40fc2a0 msgr2=0x7ff2f406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:35.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 shutdown_connections 2024-09-19T07:04:35.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:04:35.566+0000 7ff2fa044640 1 -- 172.21.15.29:0/923890209 wait complete. 2024-09-19T07:04:35.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:35 smithi078 ceph-mon[34556]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:35 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:35 smithi046 ceph-mon[34147]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:35 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:36.316 DEBUG:teuthology.orchestra.run.smithi029:osd.9> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T07:04:36.319 INFO:tasks.cephadm:Deploying osd.10 on smithi046 with /dev/vg_nvme/lv_1... 2024-09-19T07:04:36.319 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:04:36.572 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:36.572 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:36.572 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:36 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:36.589 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:04:36.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:36 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:36.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:36 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:36.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:36 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:36.710 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:36 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:36.710 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:36 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:36.710 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:36 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:37.778 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:37 smithi029 ceph-mon[31255]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:37.778 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:04:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:04:37.595+0000 7f4df0d81640 -1 osd.9 0 log_to_monitors true 2024-09-19T07:04:37.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:37 smithi078 ceph-mon[34556]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:37 smithi046 ceph-mon[34147]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:38.816 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:38 smithi046 ceph-mon[34147]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:04:38.818 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:38 smithi029 ceph-mon[31255]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:04:38.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:38 smithi078 ceph-mon[34556]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:04:39.588 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:04:39.576+0000 7f4decd04640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.589 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.590 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.590 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.590 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:39.590 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:39.590 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.621 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T07:04:39.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_1 2024-09-19T07:04:39.841 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:04:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:04:39.587+0000 7f4de8b2c640 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:04:39.906 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:39.938 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:39 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:39.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:39 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:40.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 -- 172.21.15.46:0/3415490216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc1037d0 msgr2=0x7f1bbc10a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:40.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 --2- 172.21.15.46:0/3415490216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc1037d0 0x7f1bbc10a060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009900 tx=0x7f1bac02a410 comp rx=0 tx=0).stop 2024-09-19T07:04:40.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 -- 172.21.15.46:0/3415490216 shutdown_connections 2024-09-19T07:04:40.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 --2- 172.21.15.46:0/3415490216 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc1037d0 0x7f1bbc10a060 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 --2- 172.21.15.46:0/3415490216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc102e10 0x7f1bbc103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 --2- 172.21.15.46:0/3415490216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bbc101c10 0x7f1bbc102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 -- 172.21.15.46:0/3415490216 >> 172.21.15.46:0/3415490216 conn(0x7f1bbc0fd3c0 msgr2=0x7f1bbc0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 -- 172.21.15.46:0/3415490216 shutdown_connections 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.406+0000 7f1bc2650640 1 -- 172.21.15.46:0/3415490216 wait complete. 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.407+0000 7f1bc2650640 1 Processor -- start 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.407+0000 7f1bc2650640 1 -- start start 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.407+0000 7f1bc2650640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 0x7f1bbc197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.407+0000 7f1bc2650640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bbc102e10 0x7f1bbc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bc2650640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc1037d0 0x7f1bbc19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:40.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bc2650640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc10d7a0 con 0x7f1bbc102e10 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bc2650640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc10d620 con 0x7f1bbc101c10 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bc2650640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc10d920 con 0x7f1bbc1037d0 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 0x7f1bbc197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 0x7f1bbc197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45140/0 (socket says 172.21.15.46:45140) 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 -- 172.21.15.46:0/2992317221 learned_addr learned my addr 172.21.15.46:0/2992317221 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbb7fe640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bbc102e10 0x7f1bbc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bc0bed640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc1037d0 0x7f1bbc19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 -- 172.21.15.46:0/2992317221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc1037d0 msgr2=0x7f1bbc19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc1037d0 0x7f1bbc19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 -- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bbc102e10 msgr2=0x7f1bbc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bbc102e10 0x7f1bbc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 -- 172.21.15.46:0/2992317221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc19fa30 con 0x7f1bbc101c10 2024-09-19T07:04:40.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bbbfff640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 0x7f1bbc197e00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400ccb0 tx=0x7f1bb400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4003970 con 0x7f1bbc101c10 2024-09-19T07:04:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.408+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc19fd20 con 0x7f1bbc101c10 2024-09-19T07:04:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.409+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bb4004030 con 0x7f1bbc101c10 2024-09-19T07:04:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.409+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400f6b0 con 0x7f1bbc101c10 2024-09-19T07:04:40.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.409+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc1a0270 con 0x7f1bbc101c10 2024-09-19T07:04:40.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.410+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc108f70 con 0x7f1bbc101c10 2024-09-19T07:04:40.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.411+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1bb40041e0 con 0x7f1bbc101c10 2024-09-19T07:04:40.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.411+0000 7f1bb97fa640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1ba40a7700 0x7f1ba40a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:40.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.412+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5981+0+0 (secure 0 0 0) 0x7f1bb40cf1c0 con 0x7f1bbc101c10 2024-09-19T07:04:40.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.412+0000 7f1bbb7fe640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1ba40a7700 0x7f1ba40a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:40.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.412+0000 7f1bbb7fe640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1ba40a7700 0x7f1ba40a9bc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc199320 tx=0x7f1bb0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:40.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.416+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bb4014070 con 0x7f1bbc101c10 2024-09-19T07:04:40.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:04:40.632+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1bbc062630 con 0x7f1ba40a7700 2024-09-19T07:04:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi029 2024-09-19T07:04:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi029 to 4273M 2024-09-19T07:04:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:04:40.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T07:04:40.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:40 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi029 2024-09-19T07:04:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi029 to 4273M 2024-09-19T07:04:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:04:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T07:04:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:40 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi029 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi029 to 4273M 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: from='osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi029", "root=default"]}]': finished 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:40.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:40 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:04:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:04:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] boot 2024-09-19T07:04:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T07:04:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:41.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:41.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:41.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:41.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] boot 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:41.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:41.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:41.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: osd.9 [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] boot 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:04:41.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:42.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:42 smithi029 ceph-mon[31255]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T07:04:42.917 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:42 smithi046 ceph-mon[34147]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T07:04:42.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:42 smithi078 ceph-mon[34556]: osdmap e65: 10 total, 10 up, 10 in 2024-09-19T07:04:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:43 smithi029 ceph-mon[31255]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:43 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/1679808608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]: dispatch 2024-09-19T07:04:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:43 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]: dispatch 2024-09-19T07:04:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:43 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]': finished 2024-09-19T07:04:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:43 smithi029 ceph-mon[31255]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T07:04:43.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:04:43.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:43 smithi078 ceph-mon[34556]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:43.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:43 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/1679808608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]: dispatch 2024-09-19T07:04:43.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:43 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]: dispatch 2024-09-19T07:04:43.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:43 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]': finished 2024-09-19T07:04:43.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:43 smithi078 ceph-mon[34556]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T07:04:43.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:04:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:43 smithi046 ceph-mon[34147]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:43 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/1679808608' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]: dispatch 2024-09-19T07:04:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:43 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]: dispatch 2024-09-19T07:04:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:43 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d8f44c8-3b48-47ba-80cd-cee544a6cb3c"}]': finished 2024-09-19T07:04:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:43 smithi046 ceph-mon[34147]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T07:04:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:04:44.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:44 smithi029 ceph-mon[31255]: from='client.? 172.21.15.46:0/3711842532' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:44.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:44 smithi078 ceph-mon[34556]: from='client.? 172.21.15.46:0/3711842532' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:44 smithi046 ceph-mon[34147]: from='client.? 172.21.15.46:0/3711842532' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:04:45.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:45 smithi029 ceph-mon[31255]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:45 smithi078 ceph-mon[34556]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:45 smithi046 ceph-mon[34147]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:47 smithi029 ceph-mon[31255]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:47.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:47 smithi078 ceph-mon[34556]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:47 smithi046 ceph-mon[34147]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:49.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:49 smithi029 ceph-mon[31255]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:49 smithi078 ceph-mon[34556]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:49.971 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:49 smithi046 ceph-mon[34147]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:51.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:51 smithi029 ceph-mon[31255]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:51.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:51 smithi078 ceph-mon[34556]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:51 smithi046 ceph-mon[34147]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:52.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:04:52.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:52 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:52.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:04:52.937 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:52 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:52.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:04:52.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:52 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:53.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:53 smithi029 ceph-mon[31255]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:53.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:53 smithi029 ceph-mon[31255]: Deploying daemon osd.10 on smithi046 2024-09-19T07:04:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:53 smithi078 ceph-mon[34556]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:53 smithi078 ceph-mon[34556]: Deploying daemon osd.10 on smithi046 2024-09-19T07:04:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:53 smithi046 ceph-mon[34147]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:53 smithi046 ceph-mon[34147]: Deploying daemon osd.10 on smithi046 2024-09-19T07:04:55.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:55 smithi078 ceph-mon[34556]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:55.960 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:55 smithi029 ceph-mon[31255]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:55.961 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:55 smithi046 ceph-mon[34147]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:57.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:57 smithi078 ceph-mon[34556]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:57 smithi046 ceph-mon[34147]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:57 smithi029 ceph-mon[31255]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:59 smithi046 ceph-mon[34147]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:59 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:59.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:59 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:59.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:04:59 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:59.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:59 smithi078 ceph-mon[34556]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:04:59.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:59 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:59.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:59 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:04:59.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:04:59 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:59 smithi029 ceph-mon[31255]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:59 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:59 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:04:59 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:01.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:01 smithi046 ceph-mon[34147]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:01.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:01 smithi078 ceph-mon[34556]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:01 smithi029 ceph-mon[31255]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:02.496 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 10 on host 'smithi046' 2024-09-19T07:05:02.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.495+0000 7f1bb97fa640 1 -- 172.21.15.46:0/2992317221 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1bbc062630 con 0x7f1ba40a7700 2024-09-19T07:05:02.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.497+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1ba40a7700 msgr2=0x7f1ba40a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:02.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.497+0000 7f1bc2650640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1ba40a7700 0x7f1ba40a9bc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc199320 tx=0x7f1bb0009110 comp rx=0 tx=0).stop 2024-09-19T07:05:02.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.497+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 msgr2=0x7f1bbc197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.497+0000 7f1bc2650640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 0x7f1bbc197e00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400ccb0 tx=0x7f1bb400a620 comp rx=0 tx=0).stop 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 shutdown_connections 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1ba40a7700 0x7f1ba40a9bc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc1037d0 0x7f1bbc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bbc102e10 0x7f1bbc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 --2- 172.21.15.46:0/2992317221 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1bbc101c10 0x7f1bbc197e00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 >> 172.21.15.46:0/2992317221 conn(0x7f1bbc0fd3c0 msgr2=0x7f1bbc106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 shutdown_connections 2024-09-19T07:05:02.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T07:05:02.498+0000 7f1bc2650640 1 -- 172.21.15.46:0/2992317221 wait complete. 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.219 DEBUG:teuthology.orchestra.run.smithi046:osd.10> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T07:05:03.225 INFO:tasks.cephadm:Deploying osd.11 on smithi078 with /dev/vg_nvme/lv_1... 2024-09-19T07:05:03.225 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:03.493 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:05:04.976 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:05:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:05:04.704+0000 7f9339e57640 -1 osd.10 0 log_to_monitors true 2024-09-19T07:05:05.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:05 smithi078 ceph-mon[34556]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:05.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:05 smithi078 ceph-mon[34556]: from='osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:05:05.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:05 smithi078 ceph-mon[34556]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:05:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:05 smithi029 ceph-mon[31255]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:05 smithi029 ceph-mon[31255]: from='osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:05:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:05 smithi029 ceph-mon[31255]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:05:05.375 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:05 smithi046 ceph-mon[34147]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:05.375 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:05 smithi046 ceph-mon[34147]: from='osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:05:05.375 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:05 smithi046 ceph-mon[34147]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:05:06.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:06 smithi078 ceph-mon[34556]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:05:06.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:06 smithi078 ceph-mon[34556]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T07:05:06.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:06.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:06 smithi078 ceph-mon[34556]: from='osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:05:06.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:06 smithi078 ceph-mon[34556]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:05:06.331 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-19T07:05:06.357 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi078:vg_nvme/lv_1 2024-09-19T07:05:06.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:06 smithi029 ceph-mon[31255]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:05:06.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:06 smithi029 ceph-mon[31255]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T07:05:06.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:06.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:06 smithi029 ceph-mon[31255]: from='osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:05:06.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:06 smithi029 ceph-mon[31255]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:05:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:05:06.078+0000 7f9335dda640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T07:05:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:05:06.090+0000 7f9331c02640 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:05:06.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-mon[34147]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:05:06.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-mon[34147]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T07:05:06.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:06.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-mon[34147]: from='osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:05:06.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:06 smithi046 ceph-mon[34147]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T07:05:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:05:07.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 -- 172.21.15.78:0/1624248632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c104f90 msgr2=0x7f415c107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 --2- 172.21.15.78:0/1624248632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c104f90 0x7f415c107380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4150009900 tx=0x7f415002a410 comp rx=0 tx=0).stop 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 -- 172.21.15.78:0/1624248632 shutdown_connections 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 --2- 172.21.15.78:0/1624248632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c1078c0 0x7f415c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 --2- 172.21.15.78:0/1624248632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c104f90 0x7f415c107380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 --2- 172.21.15.78:0/1624248632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f415c102660 0x7f415c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 -- 172.21.15.78:0/1624248632 >> 172.21.15.78:0/1624248632 conn(0x7f415c0fc280 msgr2=0x7f415c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 -- 172.21.15.78:0/1624248632 shutdown_connections 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 -- 172.21.15.78:0/1624248632 wait complete. 2024-09-19T07:05:07.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 Processor -- start 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.098+0000 7f41609f1640 1 -- start start 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c102660 0x7f415c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f415c104f90 0x7f415c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 0x7f415c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f415c10d780 con 0x7f415c102660 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f415c10d600 con 0x7f415c104f90 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f415c10d900 con 0x7f415c1078c0 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 0x7f415c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:07.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 0x7f415c19f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56508/0 (socket says 172.21.15.78:56508) 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 -- 172.21.15.78:0/3474552748 learned_addr learned my addr 172.21.15.78:0/3474552748 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415a59c640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c102660 0x7f415c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f4159d9b640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f415c104f90 0x7f415c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 -- 172.21.15.78:0/3474552748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f415c104f90 msgr2=0x7f415c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f415c104f90 0x7f415c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 -- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c102660 msgr2=0x7f415c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c102660 0x7f415c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 -- 172.21.15.78:0/3474552748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415c19fb00 con 0x7f415c1078c0 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415a59c640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c102660 0x7f415c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f415ad9d640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 0x7f415c19f490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4154009fd0 tx=0x7f415400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:07.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154011830 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4154016070 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.099+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415c19fdf0 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.100+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154010de0 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.100+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415c1a02c0 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.101+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f415c0fdd70 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.102+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f41540119d0 con 0x7f415c1078c0 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.103+0000 7f414b7fe640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41440a3270 0x7f41440a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:07.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.103+0000 7f415a59c640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41440a3270 0x7f41440a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:07.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.103+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6727+0+0 (secure 0 0 0) 0x7f41540ce8d0 con 0x7f415c1078c0 2024-09-19T07:05:07.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.103+0000 7f415a59c640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41440a3270 0x7f41440a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f414c005c40 tx=0x7f414c00a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:07.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.107+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f415409bc20 con 0x7f415c1078c0 2024-09-19T07:05:07.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:07.283+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f415c062630 con 0x7f41440a3270 2024-09-19T07:05:07.284 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:07.284 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi046 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-19T07:05:07.285 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.286 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:07.286 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:07.286 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.286 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] boot 2024-09-19T07:05:07.286 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T07:05:07.286 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:05:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T07:05:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi046 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] boot 2024-09-19T07:05:07.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T07:05:07.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:05:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T07:05:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T07:05:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi046 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:07.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: osd.10 [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] boot 2024-09-19T07:05:07.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T07:05:07.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:08.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:08 smithi029 ceph-mon[31255]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T07:05:08.423 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:05:08.424 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:05:08.424 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:08.424 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:08.424 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:08.424 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:08.424 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:08 smithi078 ceph-mon[34556]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi078:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:08.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:08 smithi046 ceph-mon[34147]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T07:05:09.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:09 smithi078 ceph-mon[34556]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:09.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:09 smithi078 ceph-mon[34556]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T07:05:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:09 smithi029 ceph-mon[31255]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:09 smithi029 ceph-mon[31255]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T07:05:09.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:09 smithi046 ceph-mon[34147]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:09.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:09 smithi046 ceph-mon[34147]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T07:05:10.409 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:10 smithi078 ceph-mon[34556]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T07:05:10.409 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:10 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/1536364907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]: dispatch 2024-09-19T07:05:10.409 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:10 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]: dispatch 2024-09-19T07:05:10.409 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:10 smithi078 ceph-mon[34556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]': finished 2024-09-19T07:05:10.409 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:10 smithi078 ceph-mon[34556]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T07:05:10.409 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:10.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:10 smithi029 ceph-mon[31255]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T07:05:10.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:10 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/1536364907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]: dispatch 2024-09-19T07:05:10.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:10 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]: dispatch 2024-09-19T07:05:10.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:10 smithi029 ceph-mon[31255]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]': finished 2024-09-19T07:05:10.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:10 smithi029 ceph-mon[31255]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T07:05:10.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:10.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:10 smithi046 ceph-mon[34147]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T07:05:10.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:10 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/1536364907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]: dispatch 2024-09-19T07:05:10.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:10 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]: dispatch 2024-09-19T07:05:10.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:10 smithi046 ceph-mon[34147]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd582454-ad0c-4343-b2fa-e314def66709"}]': finished 2024-09-19T07:05:10.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:10 smithi046 ceph-mon[34147]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T07:05:10.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:11.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:11 smithi029 ceph-mon[31255]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:11.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:11 smithi029 ceph-mon[31255]: from='client.? 172.21.15.78:0/1676311256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:11 smithi078 ceph-mon[34556]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:11 smithi078 ceph-mon[34556]: from='client.? 172.21.15.78:0/1676311256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:11.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:11 smithi046 ceph-mon[34147]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:11.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:11 smithi046 ceph-mon[34147]: from='client.? 172.21.15.78:0/1676311256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:05:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:13 smithi029 ceph-mon[31255]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-19T07:05:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:13 smithi078 ceph-mon[34556]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-19T07:05:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:13 smithi046 ceph-mon[34147]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-19T07:05:15.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:15 smithi029 ceph-mon[31255]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:05:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:15 smithi078 ceph-mon[34556]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:05:15.728 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:15 smithi046 ceph-mon[34147]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:05:17.489 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:17 smithi078 ceph-mon[34556]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T07:05:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:17 smithi029 ceph-mon[31255]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T07:05:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:17 smithi046 ceph-mon[34147]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T07:05:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:19 smithi029 ceph-mon[31255]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T07:05:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:05:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:19 smithi029 ceph-mon[31255]: Deploying daemon osd.11 on smithi078 2024-09-19T07:05:19.693 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:19 smithi078 ceph-mon[34556]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T07:05:19.693 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:05:19.694 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:19.694 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:19 smithi078 ceph-mon[34556]: Deploying daemon osd.11 on smithi078 2024-09-19T07:05:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:19 smithi046 ceph-mon[34147]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T07:05:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:05:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:19 smithi046 ceph-mon[34147]: Deploying daemon osd.11 on smithi078 2024-09-19T07:05:21.619 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:21 smithi078 ceph-mon[34556]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:05:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:21 smithi029 ceph-mon[31255]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:05:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:21 smithi046 ceph-mon[34147]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:05:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:23 smithi078 ceph-mon[34556]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:05:23.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:23 smithi029 ceph-mon[31255]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:05:23.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:23 smithi046 ceph-mon[34147]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:05:25.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:25 smithi078 ceph-mon[34556]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:25.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:25.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:25.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:25 smithi029 ceph-mon[31255]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:25 smithi046 ceph-mon[34147]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:25.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:27.572 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:27 smithi078 ceph-mon[34556]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.609+0000 7f414b7fe640 1 -- 172.21.15.78:0/3474552748 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f415c062630 con 0x7f41440a3270 2024-09-19T07:05:27.611 INFO:teuthology.orchestra.run.smithi078.stdout:Created osd(s) 11 on host 'smithi078' 2024-09-19T07:05:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41440a3270 msgr2=0x7f41440a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41440a3270 0x7f41440a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f414c005c40 tx=0x7f414c00a570 comp rx=0 tx=0).stop 2024-09-19T07:05:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 msgr2=0x7f415c19f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 0x7f415c19f490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4154009fd0 tx=0x7f415400b8e0 comp rx=0 tx=0).stop 2024-09-19T07:05:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 shutdown_connections 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41440a3270 0x7f41440a5730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f415c1078c0 0x7f415c19f490 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f415c104f90 0x7f415c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 --2- 172.21.15.78:0/3474552748 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f415c102660 0x7f415c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 >> 172.21.15.78:0/3474552748 conn(0x7f415c0fc280 msgr2=0x7f415c103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 shutdown_connections 2024-09-19T07:05:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:27.612+0000 7f41609f1640 1 -- 172.21.15.78:0/3474552748 wait complete. 2024-09-19T07:05:27.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:27 smithi029 ceph-mon[31255]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:27 smithi046 ceph-mon[34147]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:28.308 DEBUG:teuthology.orchestra.run.smithi078:osd.11> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T07:05:28.310 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T07:05:28.310 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:05:28.583 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:28.869 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.870 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:28 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.912 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.912 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.912 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.912 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:28 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:28.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:28 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:29.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 -- 172.21.15.29:0/1241317692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 msgr2=0x7f7090104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 --2- 172.21.15.29:0/1241317692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090104a90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7080009900 tx=0x7f708002a410 comp rx=0 tx=0).stop 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 -- 172.21.15.29:0/1241317692 shutdown_connections 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 --2- 172.21.15.29:0/1241317692 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 0x7f7090109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 --2- 172.21.15.29:0/1241317692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7090104fd0 0x7f70901073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 --2- 172.21.15.29:0/1241317692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090104a90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 -- 172.21.15.29:0/1241317692 >> 172.21.15.29:0/1241317692 conn(0x7f70900fc2a0 msgr2=0x7f70900fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 -- 172.21.15.29:0/1241317692 shutdown_connections 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.090+0000 7f709647e640 1 -- 172.21.15.29:0/1241317692 wait complete. 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 Processor -- start 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 -- start start 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:29.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7090104fd0 0x7f7090198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 0x7f709019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f709010d780 con 0x7f70901026a0 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f709010d600 con 0x7f7090104fd0 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.091+0000 7f709647e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f709010d900 con 0x7f7090107900 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50168/0 (socket says 172.21.15.29:50168) 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 -- 172.21.15.29:0/2740135861 learned_addr learned my addr 172.21.15.29:0/2740135861 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f7094a1b640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 0x7f709019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708f7fe640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7090104fd0 0x7f7090198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 -- 172.21.15.29:0/2740135861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 msgr2=0x7f709019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 0x7f709019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 -- 172.21.15.29:0/2740135861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7090104fd0 msgr2=0x7f7090198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:29.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7090104fd0 0x7f7090198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 -- 172.21.15.29:0/2740135861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709019fa70 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f7094a1b640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 0x7f709019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708ffff640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090197e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7080004770 tx=0x7f70800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708003f030 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7080003cb0 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709019fd00 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080035070 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.092+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70901a0190 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.093+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70900fdd90 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.094+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7080042030 con 0x7f70901026a0 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.095+0000 7f708d7fa640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70780a3270 0x7f70780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:29.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.095+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f70800ef8c0 con 0x7f70901026a0 2024-09-19T07:05:29.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.095+0000 7f708f7fe640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70780a3270 0x7f70780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:29.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.096+0000 7f708f7fe640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70780a3270 0x7f70780a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7090199360 tx=0x7f708400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:29.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.099+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70800bc570 con 0x7f70901026a0 2024-09-19T07:05:29.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.280+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f709002d9b0 con 0x7f70901026a0 2024-09-19T07:05:29.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.280+0000 7f708d7fa640 1 -- 172.21.15.29:0/2740135861 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f70800c0870 con 0x7f70901026a0 2024-09-19T07:05:29.281 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:29.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70780a3270 msgr2=0x7f70780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:29.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70780a3270 0x7f70780a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7090199360 tx=0x7f708400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 msgr2=0x7f7090197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:29.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090197e40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7080004770 tx=0x7f70800042f0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 shutdown_connections 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70780a3270 0x7f70780a5730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7090107900 0x7f709019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7090104fd0 0x7f7090198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.282+0000 7f709647e640 1 --2- 172.21.15.29:0/2740135861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70901026a0 0x7f7090197e40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.283+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 >> 172.21.15.29:0/2740135861 conn(0x7f70900fc2a0 msgr2=0x7f7090102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.283+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 shutdown_connections 2024-09-19T07:05:29.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:29.283+0000 7f709647e640 1 -- 172.21.15.29:0/2740135861 wait complete. 2024-09-19T07:05:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:29 smithi029 ceph-mon[31255]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:29 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2740135861' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:29.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:29 smithi078 ceph-mon[34556]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:29.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:29 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2740135861' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:29.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:29 smithi046 ceph-mon[34147]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:29.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:29 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2740135861' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:30.116 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726729506,"num_in_osds":12,"osd_in_since":1726729509,"num_remapped_pgs":0} 2024-09-19T07:05:30.611 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:05:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:05:30.455+0000 7f85976ce640 -1 osd.11 0 log_to_monitors true 2024-09-19T07:05:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:30 smithi029 ceph-mon[31255]: from='osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:05:30.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:30 smithi029 ceph-mon[31255]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:05:30.896 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:30 smithi078 ceph-mon[34556]: from='osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:05:30.896 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:30 smithi078 ceph-mon[34556]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:05:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:30 smithi046 ceph-mon[34147]: from='osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:05:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:30 smithi046 ceph-mon[34147]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:05:31.117 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:05:31.379 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:31.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:31 smithi029 ceph-mon[31255]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:31.830 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:31 smithi029 ceph-mon[31255]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:05:31.831 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:31 smithi029 ceph-mon[31255]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T07:05:31.831 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:31 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:31.831 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:31 smithi029 ceph-mon[31255]: from='osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:05:31.831 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:31 smithi029 ceph-mon[31255]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:05:31.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 -- 172.21.15.29:0/3224577262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20100ad0 msgr2=0x7f8a20100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 --2- 172.21.15.29:0/3224577262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20100ad0 0x7f8a20100ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009900 tx=0x7f8a1402a410 comp rx=0 tx=0).stop 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 -- 172.21.15.29:0/3224577262 shutdown_connections 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 --2- 172.21.15.29:0/3224577262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20102690 0x7f8a20108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 --2- 172.21.15.29:0/3224577262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a20101cd0 0x7f8a20102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 --2- 172.21.15.29:0/3224577262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20100ad0 0x7f8a20100ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 -- 172.21.15.29:0/3224577262 >> 172.21.15.29:0/3224577262 conn(0x7f8a200fc280 msgr2=0x7f8a200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 -- 172.21.15.29:0/3224577262 shutdown_connections 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.915+0000 7f8a26f08640 1 -- 172.21.15.29:0/3224577262 wait complete. 2024-09-19T07:05:31.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 Processor -- start 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 -- start start 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20100ad0 0x7f8a20197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 0x7f8a201983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a20102690 0x7f8a2019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010c600 con 0x7f8a20101cd0 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010c480 con 0x7f8a20100ad0 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a26f08640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010c780 con 0x7f8a20102690 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 0x7f8a201983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 0x7f8a201983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50186/0 (socket says 172.21.15.29:50186) 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 -- 172.21.15.29:0/1566529431 learned_addr learned my addr 172.21.15.29:0/1566529431 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a254a5640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a20102690 0x7f8a2019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:31.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a24ca4640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20100ad0 0x7f8a20197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 -- 172.21.15.29:0/1566529431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a20102690 msgr2=0x7f8a2019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a20102690 0x7f8a2019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 -- 172.21.15.29:0/1566529431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20100ad0 msgr2=0x7f8a20197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20100ad0 0x7f8a20197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a1ffff640 1 -- 172.21.15.29:0/1566529431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2019fac0 con 0x7f8a20101cd0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.916+0000 7f8a24ca4640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20100ad0 0x7f8a20197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.917+0000 7f8a1ffff640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 0x7f8a201983d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00e9f0 tx=0x7f8a0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.917+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00cd80 con 0x7f8a20101cd0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.917+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8a0c0054d0 con 0x7f8a20101cd0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.917+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2019fdb0 con 0x7f8a20101cd0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.917+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c010490 con 0x7f8a20101cd0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.917+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a201a0210 con 0x7f8a20101cd0 2024-09-19T07:05:31.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.918+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a201a04a0 con 0x7f8a20101cd0 2024-09-19T07:05:31.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.919+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8a0c005020 con 0x7f8a20101cd0 2024-09-19T07:05:31.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.920+0000 7f8a1dffb640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8a100a3270 0x7f8a100a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:31.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.920+0000 7f8a24ca4640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8a100a3270 0x7f8a100a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:31.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.920+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f8a0c0cf7b0 con 0x7f8a20101cd0 2024-09-19T07:05:31.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.921+0000 7f8a24ca4640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8a100a3270 0x7f8a100a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a14000c00 tx=0x7f8a14032c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:31.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:31.925+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8a0c09c9f0 con 0x7f8a20101cd0 2024-09-19T07:05:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:31 smithi078 ceph-mon[34556]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:31 smithi078 ceph-mon[34556]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:05:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:31 smithi078 ceph-mon[34556]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T07:05:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:31 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:31 smithi078 ceph-mon[34556]: from='osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:05:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:31 smithi078 ceph-mon[34556]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:05:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:31 smithi046 ceph-mon[34147]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:31 smithi046 ceph-mon[34147]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:05:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:31 smithi046 ceph-mon[34147]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T07:05:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:31 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:31 smithi046 ceph-mon[34147]: from='osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:05:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:31 smithi046 ceph-mon[34147]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]: dispatch 2024-09-19T07:05:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.104+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8a201a0d40 con 0x7f8a20101cd0 2024-09-19T07:05:32.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.105+0000 7f8a1dffb640 1 -- 172.21.15.29:0/1566529431 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f8a0c09c2f0 con 0x7f8a20101cd0 2024-09-19T07:05:32.106 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:32.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8a100a3270 msgr2=0x7f8a100a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8a100a3270 0x7f8a100a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8a14000c00 tx=0x7f8a14032c40 comp rx=0 tx=0).stop 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 msgr2=0x7f8a201983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 0x7f8a201983d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00e9f0 tx=0x7f8a0c00edf0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 shutdown_connections 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8a100a3270 0x7f8a100a5730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a20102690 0x7f8a2019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a20101cd0 0x7f8a201983d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 --2- 172.21.15.29:0/1566529431 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8a20100ad0 0x7f8a20197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 >> 172.21.15.29:0/1566529431 conn(0x7f8a200fc280 msgr2=0x7f8a2006a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 shutdown_connections 2024-09-19T07:05:32.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:32.107+0000 7f8a26f08640 1 -- 172.21.15.29:0/1566529431 wait complete. 2024-09-19T07:05:32.622 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:05:32.351+0000 7f8593651640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T07:05:32.623 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:05:32.363+0000 7f858b471640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:05:32.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:05:32.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T07:05:32.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:32.785 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: Detected new or changed devices on smithi078 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi078 to 4272M 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:32.786 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:32.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:32.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:32.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1566529431' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:32.787 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:32 smithi029 ceph-mon[31255]: from='osd.11 ' entity='osd.11' 2024-09-19T07:05:32.816 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726729506,"num_in_osds":12,"osd_in_since":1726729509,"num_remapped_pgs":0} 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: Detected new or changed devices on smithi078 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi078 to 4272M 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:32.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:32.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1566529431' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:32.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:32 smithi078 ceph-mon[34556]: from='osd.11 ' entity='osd.11' 2024-09-19T07:05:32.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi078", "root=default"]}]': finished 2024-09-19T07:05:32.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T07:05:32.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:32.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: Detected new or changed devices on smithi078 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi078 to 4272M 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:32.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:32.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:32.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:32.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:32.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1566529431' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:32.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:32 smithi046 ceph-mon[34147]: from='osd.11 ' entity='osd.11' 2024-09-19T07:05:33.818 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: purged_snaps scrub starts 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: purged_snaps scrub ok 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] boot 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:05:33.940 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:33 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: purged_snaps scrub starts 2024-09-19T07:05:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: purged_snaps scrub ok 2024-09-19T07:05:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:33.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] boot 2024-09-19T07:05:33.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:05:33.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:33 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:34.088 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: purged_snaps scrub starts 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: purged_snaps scrub ok 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: osd.11 [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] boot 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:05:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:33 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 -- 172.21.15.29:0/4284367179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 msgr2=0x7fad6c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 --2- 172.21.15.29:0/4284367179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c108f20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad64009ca0 tx=0x7fad6402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 -- 172.21.15.29:0/4284367179 shutdown_connections 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 --2- 172.21.15.29:0/4284367179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c108f20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 --2- 172.21.15.29:0/4284367179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c101cd0 0x7fad6c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 --2- 172.21.15.29:0/4284367179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c100ad0 0x7fad6c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 -- 172.21.15.29:0/4284367179 >> 172.21.15.29:0/4284367179 conn(0x7fad6c0fc280 msgr2=0x7fad6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 -- 172.21.15.29:0/4284367179 shutdown_connections 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.591+0000 7fad71dad640 1 -- 172.21.15.29:0/4284367179 wait complete. 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 Processor -- start 2024-09-19T07:05:34.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 -- start start 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c100ad0 0x7fad6c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c101cd0 0x7fad6c19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c10c5e0 con 0x7fad6c102690 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c10c460 con 0x7fad6c101cd0 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad71dad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad6c10c760 con 0x7fad6c100ad0 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c19f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50210/0 (socket says 172.21.15.29:50210) 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 -- 172.21.15.29:0/1433873353 learned_addr learned my addr 172.21.15.29:0/1433873353 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6affd640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c101cd0 0x7fad6c19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6b7fe640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c100ad0 0x7fad6c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:34.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 -- 172.21.15.29:0/1433873353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c100ad0 msgr2=0x7fad6c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c100ad0 0x7fad6c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 -- 172.21.15.29:0/1433873353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c101cd0 msgr2=0x7fad6c19ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c101cd0 0x7fad6c19ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6bfff640 1 -- 172.21.15.29:0/1433873353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6c19f9c0 con 0x7fad6c102690 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.592+0000 7fad6b7fe640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c100ad0 0x7fad6c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.593+0000 7fad6bfff640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c19f0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad64009dc0 tx=0x7fad64003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.593+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64032ec0 con 0x7fad6c102690 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.593+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad640044f0 con 0x7fad6c102690 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.593+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad6c19fbf0 con 0x7fad6c102690 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.593+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64030d40 con 0x7fad6c102690 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.593+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6c1a0130 con 0x7fad6c102690 2024-09-19T07:05:34.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.594+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6c107ef0 con 0x7fad6c102690 2024-09-19T07:05:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.595+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fad64004040 con 0x7fad6c102690 2024-09-19T07:05:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.596+0000 7fad68ff9640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad540a33e0 0x7fad540a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.596+0000 7fad6b7fe640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad540a33e0 0x7fad540a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.596+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fad640f0a20 con 0x7fad6c102690 2024-09-19T07:05:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.596+0000 7fad6b7fe640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad540a33e0 0x7fad540a58a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad6c101b30 tx=0x7fad5c005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:34.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.600+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad640bdbe0 con 0x7fad6c102690 2024-09-19T07:05:34.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.778+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fad6c02d9c0 con 0x7fad6c102690 2024-09-19T07:05:34.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.778+0000 7fad68ff9640 1 -- 172.21.15.29:0/1433873353 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7fad640bd4e0 con 0x7fad6c102690 2024-09-19T07:05:34.779 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:34.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad540a33e0 msgr2=0x7fad540a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:34.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad540a33e0 0x7fad540a58a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad6c101b30 tx=0x7fad5c005e70 comp rx=0 tx=0).stop 2024-09-19T07:05:34.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 msgr2=0x7fad6c19f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c19f0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fad64009dc0 tx=0x7fad64003ba0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 shutdown_connections 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad6c102690 0x7fad6c19f0b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad6c101cd0 0x7fad6c19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad540a33e0 0x7fad540a58a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 --2- 172.21.15.29:0/1433873353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad6c100ad0 0x7fad6c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.780+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 >> 172.21.15.29:0/1433873353 conn(0x7fad6c0fc280 msgr2=0x7fad6c1050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.781+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 shutdown_connections 2024-09-19T07:05:34.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:34.781+0000 7fad71dad640 1 -- 172.21.15.29:0/1433873353 wait complete. 2024-09-19T07:05:35.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:35 smithi029 ceph-mon[31255]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:35.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:35 smithi029 ceph-mon[31255]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:05:35.523 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:35 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1433873353' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:35.553 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726729533,"num_in_osds":12,"osd_in_since":1726729509,"num_remapped_pgs":0} 2024-09-19T07:05:35.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:05:35.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:35 smithi078 ceph-mon[34556]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:35 smithi078 ceph-mon[34556]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:05:35.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:35 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1433873353' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:35 smithi046 ceph-mon[34147]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:35 smithi046 ceph-mon[34147]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:05:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:35 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1433873353' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:05:35.808 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:36.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.285+0000 7f2d621e4640 1 -- 172.21.15.29:0/2738099152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c101240 msgr2=0x7f2d5c101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.285+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2738099152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c101240 0x7f2d5c101680 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009900 tx=0x7f2d5002a410 comp rx=0 tx=0).stop 2024-09-19T07:05:36.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 -- 172.21.15.29:0/2738099152 shutdown_connections 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2738099152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 0x7f2d5c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2738099152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c101240 0x7f2d5c101680 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2738099152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d5c105a90 0x7f2d5c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 -- 172.21.15.29:0/2738099152 >> 172.21.15.29:0/2738099152 conn(0x7f2d5c077210 msgr2=0x7f2d5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 -- 172.21.15.29:0/2738099152 shutdown_connections 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 -- 172.21.15.29:0/2738099152 wait complete. 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 Processor -- start 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.286+0000 7f2d621e4640 1 -- start start 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d5c101240 0x7f2d5c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 0x7f2d5c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 0x7f2d5c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c110e60 con 0x7f2d5c105a90 2024-09-19T07:05:36.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c110ce0 con 0x7f2d5c101bc0 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c110fe0 con 0x7f2d5c101240 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 0x7f2d5c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 0x7f2d5c1a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42832/0 (socket says 172.21.15.29:42832) 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 -- 172.21.15.29:0/2667760000 learned_addr learned my addr 172.21.15.29:0/2667760000 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5affd640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 0x7f2d5c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5b7fe640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d5c101240 0x7f2d5c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 -- 172.21.15.29:0/2667760000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d5c101240 msgr2=0x7f2d5c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d5c101240 0x7f2d5c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 -- 172.21.15.29:0/2667760000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 msgr2=0x7f2d5c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 0x7f2d5c199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 -- 172.21.15.29:0/2667760000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c1a48b0 con 0x7f2d5c105a90 2024-09-19T07:05:36.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5affd640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 0x7f2d5c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d5bfff640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 0x7f2d5c1a4370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400eaa0 tx=0x7f2d5400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400cdb0 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c1a4a80 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2d54005020 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d540116d0 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.287+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c1a4f90 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.288+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c101680 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.289+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2d540051d0 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.290+0000 7f2d58ff9640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2d440a3240 0x7f2d440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.290+0000 7f2d5b7fe640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2d440a3240 0x7f2d440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.290+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f2d540cf730 con 0x7f2d5c105a90 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.291+0000 7f2d5b7fe640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2d440a3240 0x7f2d440a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009890 tx=0x7f2d4c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:36.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.294+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d54016030 con 0x7f2d5c105a90 2024-09-19T07:05:36.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.473+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d5c108fb0 con 0x7f2d5c105a90 2024-09-19T07:05:36.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.474+0000 7f2d58ff9640 1 -- 172.21.15.29:0/2667760000 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18384 (secure 0 0 0) 0x7f2d5409c8f0 con 0x7f2d5c105a90 2024-09-19T07:05:36.475 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:36.476 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":77,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:05:34.356407+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:05:36.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2d440a3240 msgr2=0x7f2d440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2d440a3240 0x7f2d440a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c009890 tx=0x7f2d4c008040 comp rx=0 tx=0).stop 2024-09-19T07:05:36.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 msgr2=0x7f2d5c1a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 0x7f2d5c1a4370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400eaa0 tx=0x7f2d5400ef60 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 shutdown_connections 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5c105a90 0x7f2d5c1a4370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d5c101bc0 0x7f2d5c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2d440a3240 0x7f2d440a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 --2- 172.21.15.29:0/2667760000 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d5c101240 0x7f2d5c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.476+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 >> 172.21.15.29:0/2667760000 conn(0x7f2d5c077210 msgr2=0x7f2d5c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.477+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 shutdown_connections 2024-09-19T07:05:36.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:36.477+0000 7f2d621e4640 1 -- 172.21.15.29:0/2667760000 wait complete. 2024-09-19T07:05:37.373 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:01:36.264211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:05:37.374 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T07:05:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:37 smithi029 ceph-mon[31255]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:37 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2667760000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:05:37.633 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:37.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:37 smithi078 ceph-mon[34556]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:37.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:37 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2667760000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:05:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:37 smithi046 ceph-mon[34147]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:37 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2667760000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:05:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 -- 172.21.15.29:0/3019753345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 msgr2=0x7f3b58100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/3019753345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58100ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009930 tx=0x7f3b4002a420 comp rx=0 tx=0).stop 2024-09-19T07:05:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 -- 172.21.15.29:0/3019753345 shutdown_connections 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/3019753345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b58101420 0x7f3b5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/3019753345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58100ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/3019753345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 0x7f3b58106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 -- 172.21.15.29:0/3019753345 >> 172.21.15.29:0/3019753345 conn(0x7f3b580fc7a0 msgr2=0x7f3b580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 -- 172.21.15.29:0/3019753345 shutdown_connections 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 -- 172.21.15.29:0/3019753345 wait complete. 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.117+0000 7f3b5dae8640 1 Processor -- start 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 -- start start 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b58101420 0x7f3b581977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 0x7f3b5819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3b58110d50 con 0x7f3b58100a80 2024-09-19T07:05:38.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3b58110bd0 con 0x7f3b58106a80 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b5dae8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b58110ed0 con 0x7f3b58101420 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42860/0 (socket says 172.21.15.29:42860) 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 -- 172.21.15.29:0/1379116388 learned_addr learned my addr 172.21.15.29:0/1379116388 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b56ffd640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b58101420 0x7f3b581977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 -- 172.21.15.29:0/1379116388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b58101420 msgr2=0x7f3b581977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b57fff640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 0x7f3b5819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b58101420 0x7f3b581977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 -- 172.21.15.29:0/1379116388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 msgr2=0x7f3b5819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 0x7f3b5819bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b577fe640 1 -- 172.21.15.29:0/1379116388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5819c220 con 0x7f3b58100a80 2024-09-19T07:05:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.118+0000 7f3b57fff640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 0x7f3b5819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.119+0000 7f3b577fe640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58197270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c920 tx=0x7f3b4800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.119+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48007c70 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.119+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5819c510 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.119+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b48007e10 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.119+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48018820 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.119+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b581a3df0 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.120+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b581021c0 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.121+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3b480189c0 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.122+0000 7f3b54ff9640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3b440a3240 0x7f3b440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.122+0000 7f3b56ffd640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3b440a3240 0x7f3b440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.122+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f3b480cf690 con 0x7f3b58100a80 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.122+0000 7f3b56ffd640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3b440a3240 0x7f3b440a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b40000c00 tx=0x7f3b40031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.126+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b48014030 con 0x7f3b58100a80 2024-09-19T07:05:38.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.301+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3b58109010 con 0x7f3b58100a80 2024-09-19T07:05:38.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.301+0000 7f3b54ff9640 1 -- 172.21.15.29:0/1379116388 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f3b4809c850 con 0x7f3b58100a80 2024-09-19T07:05:38.302 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-19T07:05:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3b440a3240 msgr2=0x7f3b440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3b440a3240 0x7f3b440a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b40000c00 tx=0x7f3b40031400 comp rx=0 tx=0).stop 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 msgr2=0x7f3b58197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58197270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c920 tx=0x7f3b4800cde0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 shutdown_connections 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b58106a80 0x7f3b5819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.303+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3b440a3240 0x7f3b440a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.304+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b58101420 0x7f3b581977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.304+0000 7f3b5dae8640 1 --2- 172.21.15.29:0/1379116388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b58100a80 0x7f3b58197270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.304+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 >> 172.21.15.29:0/1379116388 conn(0x7f3b580fc7a0 msgr2=0x7f3b580fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.304+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 shutdown_connections 2024-09-19T07:05:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:38.304+0000 7f3b5dae8640 1 -- 172.21.15.29:0/1379116388 wait complete. 2024-09-19T07:05:38.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1379116388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:05:38.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1379116388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:05:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1379116388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:05:39.108 INFO:tasks.cephadm:Adding mds.a on smithi029 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.d on smithi029 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.g on smithi029 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.j on smithi029 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.b on smithi046 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.e on smithi046 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.h on smithi046 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.k on smithi046 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.c on smithi078 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.f on smithi078 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.i on smithi078 2024-09-19T07:05:39.109 INFO:tasks.cephadm:Adding mds.l on smithi078 2024-09-19T07:05:39.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l' 2024-09-19T07:05:39.366 INFO:teuthology.orchestra.run.smithi078.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:05:39.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:39 smithi078 ceph-mon[34556]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:39.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:39 smithi029 ceph-mon[31255]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:39 smithi046 ceph-mon[34147]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:39.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 -- 172.21.15.78:0/2336501085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c102fb0 msgr2=0x7f414c103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 --2- 172.21.15.78:0/2336501085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c102fb0 0x7f414c103430 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4134009900 tx=0x7f413402a410 comp rx=0 tx=0).stop 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 -- 172.21.15.78:0/2336501085 shutdown_connections 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 --2- 172.21.15.78:0/2336501085 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f414c103970 0x7f414c10a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 --2- 172.21.15.78:0/2336501085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c102fb0 0x7f414c103430 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 --2- 172.21.15.78:0/2336501085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c0fff30 0x7f414c100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 -- 172.21.15.78:0/2336501085 >> 172.21.15.78:0/2336501085 conn(0x7f414c0fba80 msgr2=0x7f414c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 -- 172.21.15.78:0/2336501085 shutdown_connections 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.840+0000 7f4150fbb640 1 -- 172.21.15.78:0/2336501085 wait complete. 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 Processor -- start 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 -- start start 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f414c0fff30 0x7f414c102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c102fb0 0x7f414c100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 0x7f414c1014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f414c10d730 con 0x7f414c0fff30 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f414c10d5b0 con 0x7f414c102fb0 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4150fbb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f414c10d8b0 con 0x7f414c103970 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f414ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 0x7f414c1014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f414ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 0x7f414c1014a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55674/0 (socket says 172.21.15.78:55674) 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f414ad9d640 1 -- 172.21.15.78:0/3354359174 learned_addr learned my addr 172.21.15.78:0/3354359174 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f4143fff640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c102fb0 0x7f414c100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.841+0000 7f414a59c640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f414c0fff30 0x7f414c102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f414ad9d640 1 -- 172.21.15.78:0/3354359174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c102fb0 msgr2=0x7f414c100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f414ad9d640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c102fb0 0x7f414c100f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f414ad9d640 1 -- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f414c0fff30 msgr2=0x7f414c102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f414ad9d640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f414c0fff30 0x7f414c102910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f414ad9d640 1 -- 172.21.15.78:0/3354359174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c1019e0 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f414ad9d640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 0x7f414c1014a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f414400eaa0 tx=0x7f414400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mon.1 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414400cdb0 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f414c101cd0 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mon.1 v2:172.21.15.78:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4144005020 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mon.1 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41440116d0 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.842+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f414c1a68c0 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.843+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f414c100330 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.844+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mon.1 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f41440051d0 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.845+0000 7f41437fe640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41380a3240 0x7f41380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.845+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mon.1 v2:172.21.15.78:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f41440cf710 con 0x7f414c103970 2024-09-19T07:05:39.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.845+0000 7f414a59c640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41380a3240 0x7f41380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.846+0000 7f414a59c640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41380a3240 0x7f41380a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f413c0058c0 tx=0x7f413c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:39.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:39.849+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mon.1 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4144016030 con 0x7f414c103970 2024-09-19T07:05:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.028+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l", "target": ["mon-mgr", ""]}) -- 0x7f414c062830 con 0x7f41380a3240 2024-09-19T07:05:40.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.036+0000 7f41437fe640 1 -- 172.21.15.78:0/3354359174 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f414c062830 con 0x7f41380a3240 2024-09-19T07:05:40.037 INFO:teuthology.orchestra.run.smithi078.stdout:Scheduled mds.all update... 2024-09-19T07:05:40.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41380a3240 msgr2=0x7f41380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41380a3240 0x7f41380a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f413c0058c0 tx=0x7f413c00a4c0 comp rx=0 tx=0).stop 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 msgr2=0x7f414c1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 0x7f414c1014a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f414400eaa0 tx=0x7f414400ef60 comp rx=0 tx=0).stop 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 shutdown_connections 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f41380a3240 0x7f41380a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f414c103970 0x7f414c1014a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f414c102fb0 0x7f414c100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 --2- 172.21.15.78:0/3354359174 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f414c0fff30 0x7f414c102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.038+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 >> 172.21.15.78:0/3354359174 conn(0x7f414c0fba80 msgr2=0x7f414c106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.039+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 shutdown_connections 2024-09-19T07:05:40.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-19T07:05:40.039+0000 7f4150fbb640 1 -- 172.21.15.78:0/3354359174 wait complete. 2024-09-19T07:05:40.742 DEBUG:teuthology.orchestra.run.smithi029:mds.a> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T07:05:40.745 DEBUG:teuthology.orchestra.run.smithi029:mds.d> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T07:05:40.788 DEBUG:teuthology.orchestra.run.smithi029:mds.g> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T07:05:40.831 DEBUG:teuthology.orchestra.run.smithi029:mds.j> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T07:05:40.874 DEBUG:teuthology.orchestra.run.smithi046:mds.b> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T07:05:40.876 DEBUG:teuthology.orchestra.run.smithi046:mds.e> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T07:05:40.920 DEBUG:teuthology.orchestra.run.smithi046:mds.h> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T07:05:40.963 DEBUG:teuthology.orchestra.run.smithi046:mds.k> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T07:05:41.008 DEBUG:teuthology.orchestra.run.smithi078:mds.c> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T07:05:41.010 DEBUG:teuthology.orchestra.run.smithi078:mds.f> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T07:05:41.054 DEBUG:teuthology.orchestra.run.smithi078:mds.i> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T07:05:41.096 DEBUG:teuthology.orchestra.run.smithi078:mds.l> sudo journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T07:05:41.140 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T07:05:41.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:05:41.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: Saving service mds.all spec with placement smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l;count:12 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:41 smithi078 ceph-mon[34556]: Deploying daemon mds.l on smithi078 2024-09-19T07:05:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: Saving service mds.all spec with placement smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l;count:12 2024-09-19T07:05:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:41.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:41.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:41.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:41.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:41.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:41.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:41 smithi046 ceph-mon[34147]: Deploying daemon mds.l on smithi078 2024-09-19T07:05:41.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: Saving service mds.all spec with placement smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l;count:12 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:41.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:41 smithi029 ceph-mon[31255]: Deploying daemon mds.l on smithi078 2024-09-19T07:05:41.399 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 -- 172.21.15.29:0/1137963294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 msgr2=0x7fad10100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 --2- 172.21.15.29:0/1137963294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10100ee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fad04009930 tx=0x7fad0402a420 comp rx=0 tx=0).stop 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 -- 172.21.15.29:0/1137963294 shutdown_connections 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 --2- 172.21.15.29:0/1137963294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad10101420 0x7fad1010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 --2- 172.21.15.29:0/1137963294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10100ee0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 --2- 172.21.15.29:0/1137963294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 0x7fad10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.853+0000 7fad15682640 1 -- 172.21.15.29:0/1137963294 >> 172.21.15.29:0/1137963294 conn(0x7fad100fc7a0 msgr2=0x7fad100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:41.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 -- 172.21.15.29:0/1137963294 shutdown_connections 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 -- 172.21.15.29:0/1137963294 wait complete. 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 Processor -- start 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 -- start start 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad10101420 0x7fad10199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.854+0000 7fad15682640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 0x7fad101a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad15682640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad10110d80 con 0x7fad10100a80 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad15682640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fad10110c00 con 0x7fad10101420 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad15682640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad10110f00 con 0x7fad10106a80 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:42870/0 (socket says 172.21.15.29:42870) 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 -- 172.21.15.29:0/3979154274 learned_addr learned my addr 172.21.15.29:0/3979154274 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:41.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0e7fc640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad10101420 0x7fad10199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0f7fe640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 0x7fad101a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 -- 172.21.15.29:0/3979154274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 msgr2=0x7fad101a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 0x7fad101a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 -- 172.21.15.29:0/3979154274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad10101420 msgr2=0x7fad10199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad10101420 0x7fad10199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 -- 172.21.15.29:0/3979154274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad101a4810 con 0x7fad10100a80 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0f7fe640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 0x7fad101a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad0effd640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10199250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e9f0 tx=0x7fad0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0000cd80 con 0x7fad10100a80 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad101a49e0 con 0x7fad10100a80 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad000108e0 con 0x7fad10100a80 2024-09-19T07:05:41.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00018920 con 0x7fad10100a80 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.855+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad101a4ef0 con 0x7fad10100a80 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.856+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad10100ee0 con 0x7fad10100a80 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.858+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fad00010a90 con 0x7fad10100a80 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.859+0000 7facf7fff640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7facf80a3240 0x7facf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.859+0000 7fad0e7fc640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7facf80a3240 0x7facf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.859+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fad000d0160 con 0x7fad10100a80 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.860+0000 7fad0e7fc640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7facf80a3240 0x7facf80a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad04006010 tx=0x7fad04000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:41.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:41.862+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad00026070 con 0x7fad10100a80 2024-09-19T07:05:42.076 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:42.076 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":1,"btime":"2024-09-19T06:58:24:064353+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T07:05:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.074+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad10108ff0 con 0x7fad10100a80 2024-09-19T07:05:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.075+0000 7facf7fff640 1 -- 172.21.15.29:0/3979154274 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fad0009d280 con 0x7fad10100a80 2024-09-19T07:05:42.076 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 1 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7facf80a3240 msgr2=0x7facf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7facf80a3240 0x7facf80a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad04006010 tx=0x7fad04000bc0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 msgr2=0x7fad10199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10199250 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fad0000e9f0 tx=0x7fad0000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 shutdown_connections 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7facf80a3240 0x7facf80a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad10106a80 0x7fad101a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad10101420 0x7fad10199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 --2- 172.21.15.29:0/3979154274 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad10100a80 0x7fad10199250 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 >> 172.21.15.29:0/3979154274 conn(0x7fad100fc7a0 msgr2=0x7fad100fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:42.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 shutdown_connections 2024-09-19T07:05:42.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:42.077+0000 7fad15682640 1 -- 172.21.15.29:0/3979154274 wait complete. 2024-09-19T07:05:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:43 smithi029 ceph-mon[31255]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:43 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3979154274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:43 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.78:6832/1477599720,v1:172.21.15.78:6833/1477599720] up:boot 2024-09-19T07:05:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:43 smithi029 ceph-mon[31255]: fsmap 1 up:standby 2024-09-19T07:05:43.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:43 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:05:43.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:43 smithi078 ceph-mon[34556]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:43.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:43 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3979154274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:43.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:43 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.78:6832/1477599720,v1:172.21.15.78:6833/1477599720] up:boot 2024-09-19T07:05:43.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:43 smithi078 ceph-mon[34556]: fsmap 1 up:standby 2024-09-19T07:05:43.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:43 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:05:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:43 smithi046 ceph-mon[34147]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:43 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3979154274' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:43 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.78:6832/1477599720,v1:172.21.15.78:6833/1477599720] up:boot 2024-09-19T07:05:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:43 smithi046 ceph-mon[34147]: fsmap 1 up:standby 2024-09-19T07:05:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:43 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:05:44.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:44.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:44.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:44.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:44 smithi029 ceph-mon[31255]: Deploying daemon mds.k on smithi046 2024-09-19T07:05:44.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:44.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:44.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:44.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:44 smithi078 ceph-mon[34556]: Deploying daemon mds.k on smithi046 2024-09-19T07:05:44.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:44.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:44.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:44.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:44.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:44 smithi046 ceph-mon[34147]: Deploying daemon mds.k on smithi046 2024-09-19T07:05:44.837 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:05:45.105 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:45 smithi029 ceph-mon[31255]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:45.395 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:45 smithi046 ceph-mon[34147]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:45.395 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 systemd[1]: Starting Ceph mds.k for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:05:45.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:45 smithi078 ceph-mon[34556]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:45.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 -- 172.21.15.29:0/1948852058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102ef0 msgr2=0x7f1b2010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 --2- 172.21.15.29:0/1948852058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102ef0 0x7f1b2010da40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009ca0 tx=0x7f1b1802a950 comp rx=0 tx=0).stop 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 -- 172.21.15.29:0/1948852058 shutdown_connections 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 --2- 172.21.15.29:0/1948852058 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102ef0 0x7f1b2010da40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 --2- 172.21.15.29:0/1948852058 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b20102570 0x7f1b201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 --2- 172.21.15.29:0/1948852058 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b20100e20 0x7f1b20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 -- 172.21.15.29:0/1948852058 >> 172.21.15.29:0/1948852058 conn(0x7f1b200fc7d0 msgr2=0x7f1b200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 -- 172.21.15.29:0/1948852058 shutdown_connections 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.549+0000 7f1b25ead640 1 -- 172.21.15.29:0/1948852058 wait complete. 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 Processor -- start 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 -- start start 2024-09-19T07:05:45.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b20100e20 0x7f1b200fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 0x7f1b200fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b20102ef0 0x7f1b200fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20110e50 con 0x7f1b20102570 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20110cd0 con 0x7f1b20102ef0 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b25ead640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20110fd0 con 0x7f1b20100e20 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 0x7f1b200fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 0x7f1b200fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34252/0 (socket says 172.21.15.29:34252) 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b1effd640 1 -- 172.21.15.29:0/4093761679 learned_addr learned my addr 172.21.15.29:0/4093761679 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b1f7fe640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b20100e20 0x7f1b200fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b1effd640 1 -- 172.21.15.29:0/4093761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b20100e20 msgr2=0x7f1b200fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.550+0000 7f1b1effd640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b20100e20 0x7f1b200fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1effd640 1 -- 172.21.15.29:0/4093761679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b20102ef0 msgr2=0x7f1b200fd700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:05:45.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1effd640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b20102ef0 0x7f1b200fd700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1effd640 1 -- 172.21.15.29:0/4093761679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b201a68b0 con 0x7f1b20102570 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1effd640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 0x7f1b200fd1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400e9f0 tx=0x7f1b1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1400cd80 con 0x7f1b20102570 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1b140108e0 con 0x7f1b20102570 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b201a6ba0 con 0x7f1b20102570 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14018920 con 0x7f1b20102570 2024-09-19T07:05:45.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.551+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b201a70e0 con 0x7f1b20102570 2024-09-19T07:05:45.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.552+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b20101200 con 0x7f1b20102570 2024-09-19T07:05:45.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.554+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1b14010a90 con 0x7f1b20102570 2024-09-19T07:05:45.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.554+0000 7f1b1cff9640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1b080a3240 0x7f1b080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:45.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.554+0000 7f1b1f7fe640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1b080a3240 0x7f1b080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:45.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.554+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f1b140cf8a0 con 0x7f1b20102570 2024-09-19T07:05:45.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.555+0000 7f1b1f7fe640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1b080a3240 0x7f1b080a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009890 tx=0x7f1b10008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:45.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.559+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b1409ca60 con 0x7f1b20102570 2024-09-19T07:05:45.671 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 podman[62738]: 2024-09-19 07:05:45.297205211 +0000 UTC m=+0.016398498 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:05:45.671 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 podman[62738]: 2024-09-19 07:05:45.418208167 +0000 UTC m=+0.137401439 container create 74e5726e7fbc3b6e7a8f4612bb599cbcaa3a79951fa4cfa8f78be155789b6c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:05:45.671 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 podman[62738]: 2024-09-19 07:05:45.670893404 +0000 UTC m=+0.390086688 container init 74e5726e7fbc3b6e7a8f4612bb599cbcaa3a79951fa4cfa8f78be155789b6c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:05:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.770+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b2010a0a0 con 0x7f1b20102570 2024-09-19T07:05:45.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.771+0000 7f1b1cff9640 1 -- 172.21.15.29:0/4093761679 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f1b1409c360 con 0x7f1b20102570 2024-09-19T07:05:45.772 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:45.772 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":2,"btime":"2024-09-19T07:05:42:965390+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:05:45.772 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 2 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1b080a3240 msgr2=0x7f1b080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1b080a3240 0x7f1b080a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009890 tx=0x7f1b10008040 comp rx=0 tx=0).stop 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 msgr2=0x7f1b200fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 0x7f1b200fd1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400e9f0 tx=0x7f1b1400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 shutdown_connections 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b20102ef0 0x7f1b200fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b20102570 0x7f1b200fd1c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1b080a3240 0x7f1b080a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 --2- 172.21.15.29:0/4093761679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b20100e20 0x7f1b200fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:45.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 >> 172.21.15.29:0/4093761679 conn(0x7f1b200fc7d0 msgr2=0x7f1b2006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:45.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 shutdown_connections 2024-09-19T07:05:45.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:45.773+0000 7f1b25ead640 1 -- 172.21.15.29:0/4093761679 wait complete. 2024-09-19T07:05:45.975 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 podman[62738]: 2024-09-19 07:05:45.674152054 +0000 UTC m=+0.393345328 container start 74e5726e7fbc3b6e7a8f4612bb599cbcaa3a79951fa4cfa8f78be155789b6c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:05:45.975 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 ceph-mds[62757]: -- 172.21.15.46:0/1626534961 <== mon.2 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a2f5f6d860 con 0x55a2f5f4b000 2024-09-19T07:05:45.976 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k[62753]: starting mds.k at 2024-09-19T07:05:45.976 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 bash[62738]: 74e5726e7fbc3b6e7a8f4612bb599cbcaa3a79951fa4cfa8f78be155789b6c72 2024-09-19T07:05:45.976 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:05:45 smithi046 systemd[1]: Started Ceph mds.k for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4093761679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:46.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:46 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4093761679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:46.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:46 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4093761679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:46.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:46.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:46 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:47.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:47 smithi029 ceph-mon[31255]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:47.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:47 smithi029 ceph-mon[31255]: Deploying daemon mds.j on smithi029 2024-09-19T07:05:47.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:47 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.46:6832/2053493152,v1:172.21.15.46:6833/2053493152] up:boot 2024-09-19T07:05:47.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:47 smithi029 ceph-mon[31255]: fsmap 2 up:standby 2024-09-19T07:05:47.370 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:05:47.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:47 smithi078 ceph-mon[34556]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:47.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:47 smithi078 ceph-mon[34556]: Deploying daemon mds.j on smithi029 2024-09-19T07:05:47.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:47 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.46:6832/2053493152,v1:172.21.15.46:6833/2053493152] up:boot 2024-09-19T07:05:47.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:47 smithi078 ceph-mon[34556]: fsmap 2 up:standby 2024-09-19T07:05:47.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:05:47.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:47 smithi046 ceph-mon[34147]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:47.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:47 smithi046 ceph-mon[34147]: Deploying daemon mds.j on smithi029 2024-09-19T07:05:47.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:47 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.46:6832/2053493152,v1:172.21.15.46:6833/2053493152] up:boot 2024-09-19T07:05:47.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:47 smithi046 ceph-mon[34147]: fsmap 2 up:standby 2024-09-19T07:05:47.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:05:48.358 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 systemd[1]: Starting Ceph mds.j for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:05:48.494 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:05:48.610 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 podman[70899]: 2024-09-19 07:05:48.26078321 +0000 UTC m=+0.016334307 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:05:48.611 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 podman[70899]: 2024-09-19 07:05:48.378979403 +0000 UTC m=+0.134530539 container create 5c3613ca38cb0fd0ba7e89e2dcafd916b9d949fbb6c9f61aa21fec9894fc5b3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T07:05:48.611 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 podman[70899]: 2024-09-19 07:05:48.61034684 +0000 UTC m=+0.365897945 container init 5c3613ca38cb0fd0ba7e89e2dcafd916b9d949fbb6c9f61aa21fec9894fc5b3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:05:48.794 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:48.874 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 podman[70899]: 2024-09-19 07:05:48.613769126 +0000 UTC m=+0.369320221 container start 5c3613ca38cb0fd0ba7e89e2dcafd916b9d949fbb6c9f61aa21fec9894fc5b3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T07:05:48.874 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 ceph-mds[70936]: -- 172.21.15.29:0/1382441782 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556335481860 con 0x55633545e800 2024-09-19T07:05:48.874 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j[70914]: starting mds.j at 2024-09-19T07:05:48.874 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 bash[70899]: 5c3613ca38cb0fd0ba7e89e2dcafd916b9d949fbb6c9f61aa21fec9894fc5b3a 2024-09-19T07:05:48.874 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:05:48 smithi029 systemd[1]: Started Ceph mds.j for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:05:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.303+0000 7fc0471e4640 1 -- 172.21.15.29:0/350993285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 msgr2=0x7fc0401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.303+0000 7fc0471e4640 1 --2- 172.21.15.29:0/350993285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc0401067e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc030009900 tx=0x7fc03002a410 comp rx=0 tx=0).stop 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 -- 172.21.15.29:0/350993285 shutdown_connections 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 --2- 172.21.15.29:0/350993285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc040106f10 0x7fc04010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 --2- 172.21.15.29:0/350993285 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc0401067e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 --2- 172.21.15.29:0/350993285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc040101de0 0x7fc0401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 -- 172.21.15.29:0/350993285 >> 172.21.15.29:0/350993285 conn(0x7fc0400fd8c0 msgr2=0x7fc0400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 -- 172.21.15.29:0/350993285 shutdown_connections 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 -- 172.21.15.29:0/350993285 wait complete. 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 Processor -- start 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.304+0000 7fc0471e4640 1 -- start start 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc0471e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc040101de0 0x7fc0401982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc0471e4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc040198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:49.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc0471e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc040106f10 0x7fc04019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc0471e4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc040111e20 con 0x7fc040102790 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc0471e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc040111ca0 con 0x7fc040101de0 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc0471e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc040111fa0 con 0x7fc040106f10 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc040198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc040198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34290/0 (socket says 172.21.15.29:34290) 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 -- 172.21.15.29:0/1876252370 learned_addr learned my addr 172.21.15.29:0/1876252370 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc045781640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc040106f10 0x7fc04019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc044f80640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc040101de0 0x7fc0401982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 -- 172.21.15.29:0/1876252370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc040106f10 msgr2=0x7fc04019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc040106f10 0x7fc04019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 -- 172.21.15.29:0/1876252370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc040101de0 msgr2=0x7fc0401982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc040101de0 0x7fc0401982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 -- 172.21.15.29:0/1876252370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04019d270 con 0x7fc040102790 2024-09-19T07:05:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.305+0000 7fc037fff640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc040198800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc030005940 tx=0x7fc030004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.306+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03003f030 con 0x7fc040102790 2024-09-19T07:05:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.306+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04019d500 con 0x7fc040102790 2024-09-19T07:05:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.306+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc030003aa0 con 0x7fc040102790 2024-09-19T07:05:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.306+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030035070 con 0x7fc040102790 2024-09-19T07:05:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.306+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0401a4e40 con 0x7fc040102790 2024-09-19T07:05:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.307+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0401032c0 con 0x7fc040102790 2024-09-19T07:05:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.308+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc030042030 con 0x7fc040102790 2024-09-19T07:05:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.309+0000 7fc035ffb640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0280a3240 0x7fc0280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.310+0000 7fc044f80640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0280a3240 0x7fc0280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.310+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fc0300efc10 con 0x7fc040102790 2024-09-19T07:05:49.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.310+0000 7fc044f80640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0280a3240 0x7fc0280a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00bbe0 tx=0x7fc03c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.314+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0300bc6e0 con 0x7fc040102790 2024-09-19T07:05:49.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.540+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc04010a0f0 con 0x7fc040102790 2024-09-19T07:05:49.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.541+0000 7fc035ffb640 1 -- 172.21.15.29:0/1876252370 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fc0300c09e0 con 0x7fc040102790 2024-09-19T07:05:49.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:49.542 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":4,"btime":"2024-09-19T07:05:49:098000+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:05:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 4 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0280a3240 msgr2=0x7fc0280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0280a3240 0x7fc0280a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00bbe0 tx=0x7fc03c00b390 comp rx=0 tx=0).stop 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 msgr2=0x7fc040198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc040198800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc030005940 tx=0x7fc030004270 comp rx=0 tx=0).stop 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 shutdown_connections 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0280a3240 0x7fc0280a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc040106f10 0x7fc04019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc040102790 0x7fc040198800 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 --2- 172.21.15.29:0/1876252370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc040101de0 0x7fc0401982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 >> 172.21.15.29:0/1876252370 conn(0x7fc0400fd8c0 msgr2=0x7fc0400fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 shutdown_connections 2024-09-19T07:05:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:49.543+0000 7fc0471e4640 1 -- 172.21.15.29:0/1876252370 wait complete. 2024-09-19T07:05:50.067 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:50.067 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.067 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.067 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.067 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: Deploying daemon mds.d on smithi029 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.29:6834/3800844322,v1:172.21.15.29:6835/3800844322] up:boot 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: fsmap 3 up:standby 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:05:50.068 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:49 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1876252370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: Deploying daemon mds.d on smithi029 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.29:6834/3800844322,v1:172.21.15.29:6835/3800844322] up:boot 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: fsmap 3 up:standby 2024-09-19T07:05:50.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:05:50.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:49 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1876252370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:50.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:50.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:50.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:50.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:50.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:50.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: Deploying daemon mds.d on smithi029 2024-09-19T07:05:50.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.29:6834/3800844322,v1:172.21.15.29:6835/3800844322] up:boot 2024-09-19T07:05:50.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: fsmap 3 up:standby 2024-09-19T07:05:50.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:05:50.228 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:49 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1876252370' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:51.781 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:51 smithi029 systemd[1]: Starting Ceph mds.d for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:05:52.095 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:51 smithi029 ceph-mon[31255]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:52.095 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:51 smithi029 podman[71312]: 2024-09-19 07:05:51.74058345 +0000 UTC m=+0.016611110 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:05:52.095 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:51 smithi029 podman[71312]: 2024-09-19 07:05:51.856422136 +0000 UTC m=+0.132449781 container create a662b06beb8d290f3d14dbda7cd57883e092c95477904e33cbe4c5dd70aefce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T07:05:52.095 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:52 smithi029 podman[71312]: 2024-09-19 07:05:52.094776634 +0000 UTC m=+0.370804290 container init a662b06beb8d290f3d14dbda7cd57883e092c95477904e33cbe4c5dd70aefce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T07:05:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:51 smithi078 ceph-mon[34556]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:52.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:51 smithi046 ceph-mon[34147]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:52.374 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:52 smithi029 podman[71312]: 2024-09-19 07:05:52.097873321 +0000 UTC m=+0.373900966 container start a662b06beb8d290f3d14dbda7cd57883e092c95477904e33cbe4c5dd70aefce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:05:52.374 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:52 smithi029 ceph-mds[71331]: -- 172.21.15.29:0/3170298673 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577aea03860 con 0x5577ae9e1000 2024-09-19T07:05:52.374 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:52 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d[71327]: starting mds.d at 2024-09-19T07:05:52.374 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:52 smithi029 bash[71312]: a662b06beb8d290f3d14dbda7cd57883e092c95477904e33cbe4c5dd70aefce1 2024-09-19T07:05:52.374 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:05:52 smithi029 systemd[1]: Started Ceph mds.d for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:05:52.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:05:53.021 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:53.438 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: Deploying daemon mds.e on smithi046 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.29:6836/2671963578,v1:172.21.15.29:6837/2671963578] up:boot 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: fsmap 4 up:standby 2024-09-19T07:05:53.439 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 -- 172.21.15.29:0/2801349243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44106f10 msgr2=0x7fbf4410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 --2- 172.21.15.29:0/2801349243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44106f10 0x7fbf4410ea90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009ca0 tx=0x7fbf3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 -- 172.21.15.29:0/2801349243 shutdown_connections 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 --2- 172.21.15.29:0/2801349243 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44106f10 0x7fbf4410ea90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 --2- 172.21.15.29:0/2801349243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44102790 0x7fbf441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 --2- 172.21.15.29:0/2801349243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44101de0 0x7fbf441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 -- 172.21.15.29:0/2801349243 >> 172.21.15.29:0/2801349243 conn(0x7fbf440fd8c0 msgr2=0x7fbf440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:53.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 -- 172.21.15.29:0/2801349243 shutdown_connections 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.521+0000 7fbf496da640 1 -- 172.21.15.29:0/2801349243 wait complete. 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 Processor -- start 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 -- start start 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44101de0 0x7fbf44198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 0x7fbf441987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44106f10 0x7fbf4419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44111e20 con 0x7fbf44102790 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44111ca0 con 0x7fbf44101de0 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf496da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf44111fa0 con 0x7fbf44106f10 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 0x7fbf441987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:53.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 0x7fbf441987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34318/0 (socket says 172.21.15.29:34318) 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 -- 172.21.15.29:0/1775146030 learned_addr learned my addr 172.21.15.29:0/1775146030 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf42ffd640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44101de0 0x7fbf44198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf437fe640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44106f10 0x7fbf4419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 -- 172.21.15.29:0/1775146030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44106f10 msgr2=0x7fbf4419cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44106f10 0x7fbf4419cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 -- 172.21.15.29:0/1775146030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44101de0 msgr2=0x7fbf44198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44101de0 0x7fbf44198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf427fc640 1 -- 172.21.15.29:0/1775146030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4419d230 con 0x7fbf44102790 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf437fe640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44106f10 0x7fbf4419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.522+0000 7fbf42ffd640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44101de0 0x7fbf44198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.523+0000 7fbf427fc640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 0x7fbf441987c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c920 tx=0x7fbf3800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:53.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.523+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38007c70 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.523+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4419d520 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.523+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbf38007e10 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.523+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf38018820 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.523+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf441a4e00 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.524+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf441021c0 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.525+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbf380189c0 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.526+0000 7fbf2bfff640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf2c0a3240 0x7fbf2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.526+0000 7fbf42ffd640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf2c0a3240 0x7fbf2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.526+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fbf380cf890 con 0x7fbf44102790 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.526+0000 7fbf42ffd640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf2c0a3240 0x7fbf2c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009b50 tx=0x7fbf34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:53.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.529+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf38014030 con 0x7fbf44102790 2024-09-19T07:05:53.565 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:53.565 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.565 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.565 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: Deploying daemon mds.e on smithi046 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.29:6836/2671963578,v1:172.21.15.29:6837/2671963578] up:boot 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: fsmap 4 up:standby 2024-09-19T07:05:53.566 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:05:53.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: Deploying daemon mds.e on smithi046 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.29:6836/2671963578,v1:172.21.15.29:6837/2671963578] up:boot 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: fsmap 4 up:standby 2024-09-19T07:05:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:05:53.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.741+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf441995e0 con 0x7fbf44102790 2024-09-19T07:05:53.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.741+0000 7fbf2bfff640 1 -- 172.21.15.29:0/1775146030 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fbf441995e0 con 0x7fbf44102790 2024-09-19T07:05:53.743 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:53.744 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"btime":"2024-09-19T07:05:52:781074+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T07:05:53.744 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 5 2024-09-19T07:05:53.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf2c0a3240 msgr2=0x7fbf2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:53.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf2c0a3240 0x7fbf2c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009b50 tx=0x7fbf34005f90 comp rx=0 tx=0).stop 2024-09-19T07:05:53.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 msgr2=0x7fbf441987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:53.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 0x7fbf441987c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c920 tx=0x7fbf3800cde0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 shutdown_connections 2024-09-19T07:05:53.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbf2c0a3240 0x7fbf2c0a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf44106f10 0x7fbf4419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf44102790 0x7fbf441987c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 --2- 172.21.15.29:0/1775146030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbf44101de0 0x7fbf44198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:53.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 >> 172.21.15.29:0/1775146030 conn(0x7fbf440fd8c0 msgr2=0x7fbf440feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:53.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 shutdown_connections 2024-09-19T07:05:53.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:53.744+0000 7fbf496da640 1 -- 172.21.15.29:0/1775146030 wait complete. 2024-09-19T07:05:54.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:54 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1775146030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:54.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:54 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1775146030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:54.476 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 systemd[1]: Starting Ceph mds.e for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:05:54.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:54 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1775146030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:54.835 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 podman[63056]: 2024-09-19 07:05:54.474591417 +0000 UTC m=+0.016862333 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:05:54.835 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 podman[63056]: 2024-09-19 07:05:54.590535839 +0000 UTC m=+0.132806784 container create 62571f68296a6ebbc0be1b6b2418ba9247182ecc2187cd625d75d1b9cd56b595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:05:54.835 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 podman[63056]: 2024-09-19 07:05:54.83502576 +0000 UTC m=+0.377296661 container init 62571f68296a6ebbc0be1b6b2418ba9247182ecc2187cd625d75d1b9cd56b595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T07:05:55.225 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 podman[63056]: 2024-09-19 07:05:54.838197534 +0000 UTC m=+0.380468442 container start 62571f68296a6ebbc0be1b6b2418ba9247182ecc2187cd625d75d1b9cd56b595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T07:05:55.225 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 ceph-mds[63075]: -- 172.21.15.46:0/1468740050 <== mon.2 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5591161ff860 con 0x5591161dd400 2024-09-19T07:05:55.225 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e[63071]: starting mds.e at 2024-09-19T07:05:55.225 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 bash[63056]: 62571f68296a6ebbc0be1b6b2418ba9247182ecc2187cd625d75d1b9cd56b595 2024-09-19T07:05:55.225 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:05:54 smithi046 systemd[1]: Started Ceph mds.e for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:05:55.560 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:55.560 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.560 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.560 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.560 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:55.560 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:55.561 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:55 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:55 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:55.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:55 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:56.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:05:56.553 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:56 smithi078 ceph-mon[34556]: Deploying daemon mds.f on smithi078 2024-09-19T07:05:56.553 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:56 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.46:6834/3031735721,v1:172.21.15.46:6835/3031735721] up:boot 2024-09-19T07:05:56.553 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:56 smithi078 ceph-mon[34556]: fsmap 5 up:standby 2024-09-19T07:05:56.553 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:56 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:05:56.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:56 smithi029 ceph-mon[31255]: Deploying daemon mds.f on smithi078 2024-09-19T07:05:56.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:56 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.46:6834/3031735721,v1:172.21.15.46:6835/3031735721] up:boot 2024-09-19T07:05:56.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:56 smithi029 ceph-mon[31255]: fsmap 5 up:standby 2024-09-19T07:05:56.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:56 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:05:56.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:56 smithi046 ceph-mon[34147]: Deploying daemon mds.f on smithi078 2024-09-19T07:05:56.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:56 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.46:6834/3031735721,v1:172.21.15.46:6835/3031735721] up:boot 2024-09-19T07:05:56.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:56 smithi046 ceph-mon[34147]: fsmap 5 up:standby 2024-09-19T07:05:56.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:56 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:05:56.742 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 -- 172.21.15.29:0/4278137956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4101420 msgr2=0x7f1ca410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- 172.21.15.29:0/4278137956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4101420 0x7f1ca410d950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c009cd0 tx=0x7f1c9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 -- 172.21.15.29:0/4278137956 shutdown_connections 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- 172.21.15.29:0/4278137956 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4101420 0x7f1ca410d950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- 172.21.15.29:0/4278137956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4100a80 0x7f1ca4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- 172.21.15.29:0/4278137956 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ca4106a80 0x7f1ca4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 -- 172.21.15.29:0/4278137956 >> 172.21.15.29:0/4278137956 conn(0x7f1ca40fc7a0 msgr2=0x7f1ca40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 -- 172.21.15.29:0/4278137956 shutdown_connections 2024-09-19T07:05:57.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 -- 172.21.15.29:0/4278137956 wait complete. 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 Processor -- start 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 -- start start 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4100a80 0x7f1ca4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ca4101420 0x7f1ca41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.250+0000 7f1caad2e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 0x7f1ca419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1caad2e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4110d30 con 0x7f1ca4106a80 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1caad2e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4110bb0 con 0x7f1ca4101420 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1caad2e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca4110eb0 con 0x7f1ca4100a80 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 0x7f1ca419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 0x7f1ca419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59456/0 (socket says 172.21.15.29:59456) 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 -- 172.21.15.29:0/2848685048 learned_addr learned my addr 172.21.15.29:0/2848685048 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca3fff640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ca4101420 0x7f1ca41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:57.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca8aca640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4100a80 0x7f1ca4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 -- 172.21.15.29:0/2848685048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4100a80 msgr2=0x7f1ca4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4100a80 0x7f1ca4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 -- 172.21.15.29:0/2848685048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ca4101420 msgr2=0x7f1ca41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ca4101420 0x7f1ca41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 -- 172.21.15.29:0/2848685048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca419d320 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca92cb640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 0x7f1ca419cc40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005cc0 tx=0x7f1c9c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c004450 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1c9c031c90 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca419d5b0 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.251+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c03b400 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.252+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca41a4ef0 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.253+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca4100ee0 con 0x7f1ca4106a80 2024-09-19T07:05:57.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.254+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1c9c004680 con 0x7f1ca4106a80 2024-09-19T07:05:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.254+0000 7f1ca1ffb640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1c8c0a32c0 0x7f1c8c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.255+0000 7f1ca8aca640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1c8c0a32c0 0x7f1c8c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.255+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f1c9c02e030 con 0x7f1ca4106a80 2024-09-19T07:05:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.255+0000 7f1ca8aca640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1c8c0a32c0 0x7f1c8c0a5780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005fd0 tx=0x7f1c94005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.259+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c9c0bd770 con 0x7f1ca4106a80 2024-09-19T07:05:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.471+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ca41a50c0 con 0x7f1ca4106a80 2024-09-19T07:05:57.472 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:57 smithi029 ceph-mon[31255]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:57.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.471+0000 7f1ca1ffb640 1 -- 172.21.15.29:0/2848685048 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7f1c9c0098b0 con 0x7f1ca4106a80 2024-09-19T07:05:57.473 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:05:57.473 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":6,"btime":"2024-09-19T07:05:55:282783+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T07:05:57.473 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 6 2024-09-19T07:05:57.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.473+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1c8c0a32c0 msgr2=0x7f1c8c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:57.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.473+0000 7f1caad2e640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1c8c0a32c0 0x7f1c8c0a5780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005fd0 tx=0x7f1c94005850 comp rx=0 tx=0).stop 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.473+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 msgr2=0x7f1ca419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.473+0000 7f1caad2e640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 0x7f1ca419cc40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005cc0 tx=0x7f1c9c003c20 comp rx=0 tx=0).stop 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.473+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 shutdown_connections 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ca4106a80 0x7f1ca419cc40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ca4101420 0x7f1ca41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1c8c0a32c0 0x7f1c8c0a5780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 --2- 172.21.15.29:0/2848685048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4100a80 0x7f1ca4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 >> 172.21.15.29:0/2848685048 conn(0x7f1ca40fc7a0 msgr2=0x7f1ca406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 shutdown_connections 2024-09-19T07:05:57.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:05:57.474+0000 7f1caad2e640 1 -- 172.21.15.29:0/2848685048 wait complete. 2024-09-19T07:05:57.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:57 smithi078 ceph-mon[34556]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:57.696 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:05:57 smithi078 systemd[1]: Started Ceph mds.f for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:05:57.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:57 smithi046 ceph-mon[34147]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2848685048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:58.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:58.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:58 smithi029 ceph-mon[31255]: Deploying daemon mds.c on smithi078 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2848685048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:58.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:58 smithi078 ceph-mon[34556]: Deploying daemon mds.c on smithi078 2024-09-19T07:05:58.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2848685048' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:58.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:05:58.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:05:58.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:05:58.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:58.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:58 smithi046 ceph-mon[34147]: Deploying daemon mds.c on smithi078 2024-09-19T07:05:59.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:59 smithi029 ceph-mon[31255]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:59.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:59 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.78:6834/1553207007,v1:172.21.15.78:6835/1553207007] up:boot 2024-09-19T07:05:59.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:59 smithi029 ceph-mon[31255]: fsmap 6 up:standby 2024-09-19T07:05:59.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:05:59 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:05:59.696 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:05:59 smithi078 systemd[1]: Starting Ceph mds.c for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:05:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:59 smithi078 ceph-mon[34556]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:59 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.78:6834/1553207007,v1:172.21.15.78:6835/1553207007] up:boot 2024-09-19T07:05:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:59 smithi078 ceph-mon[34556]: fsmap 6 up:standby 2024-09-19T07:05:59.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:05:59 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:05:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:59 smithi046 ceph-mon[34147]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:05:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:59 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.78:6834/1553207007,v1:172.21.15.78:6835/1553207007] up:boot 2024-09-19T07:05:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:59 smithi046 ceph-mon[34147]: fsmap 6 up:standby 2024-09-19T07:05:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:05:59 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:05:59.997 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:05:59 smithi078 podman[64864]: 2024-09-19 07:05:59.638004022 +0000 UTC m=+0.015730890 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:05:59.998 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:05:59 smithi078 podman[64864]: 2024-09-19 07:05:59.753104509 +0000 UTC m=+0.130831360 container create e501614f88394098e5119773397486913ff5a5b5634bd24480602650dd841f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T07:06:00.372 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:00.446 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:05:59 smithi078 podman[64864]: 2024-09-19 07:05:59.997728647 +0000 UTC m=+0.375455510 container init e501614f88394098e5119773397486913ff5a5b5634bd24480602650dd841f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:06:00.446 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:06:00 smithi078 podman[64864]: 2024-09-19 07:06:00.000917647 +0000 UTC m=+0.378644510 container start e501614f88394098e5119773397486913ff5a5b5634bd24480602650dd841f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T07:06:00.446 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:06:00 smithi078 ceph-mds[64883]: -- 172.21.15.78:0/4115026694 <== mon.1 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55714412d860 con 0x55714410b400 2024-09-19T07:06:00.446 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:06:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c[64879]: starting mds.c at 2024-09-19T07:06:00.446 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:06:00 smithi078 bash[64864]: e501614f88394098e5119773397486913ff5a5b5634bd24480602650dd841f3c 2024-09-19T07:06:00.446 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:06:00 smithi078 systemd[1]: Started Ceph mds.c for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:06:00.643 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 -- 172.21.15.29:0/1147193508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744102570 msgr2=0x7fa7441029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 --2- 172.21.15.29:0/1147193508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744102570 0x7fa7441029b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa734009900 tx=0x7fa73402a480 comp rx=0 tx=0).stop 2024-09-19T07:06:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 -- 172.21.15.29:0/1147193508 shutdown_connections 2024-09-19T07:06:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 --2- 172.21.15.29:0/1147193508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa744102ef0 0x7fa74410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 --2- 172.21.15.29:0/1147193508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744102570 0x7fa7441029b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 --2- 172.21.15.29:0/1147193508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa744100e20 0x7fa744101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 -- 172.21.15.29:0/1147193508 >> 172.21.15.29:0/1147193508 conn(0x7fa7440fc7d0 msgr2=0x7fa7440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 -- 172.21.15.29:0/1147193508 shutdown_connections 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.143+0000 7fa74b447640 1 -- 172.21.15.29:0/1147193508 wait complete. 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 Processor -- start 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 -- start start 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 0x7fa744198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa744102570 0x7fa744198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa744102ef0 0x7fa74419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa744110e30 con 0x7fa744100e20 2024-09-19T07:06:01.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa744110cb0 con 0x7fa744102570 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa74b447640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa744110fb0 con 0x7fa744102ef0 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa7491e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 0x7fa744198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.144+0000 7fa7491e3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 0x7fa744198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59476/0 (socket says 172.21.15.29:59476) 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 -- 172.21.15.29:0/1500572450 learned_addr learned my addr 172.21.15.29:0/1500572450 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7489e2640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa744102570 0x7fa744198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7499e4640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa744102ef0 0x7fa74419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 -- 172.21.15.29:0/1500572450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa744102ef0 msgr2=0x7fa74419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa744102ef0 0x7fa74419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 -- 172.21.15.29:0/1500572450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa744102570 msgr2=0x7fa744198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa744102570 0x7fa744198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 -- 172.21.15.29:0/1500572450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74419d3d0 con 0x7fa744100e20 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa7491e3640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 0x7fa744198420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa74000d770 tx=0x7fa74000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:01.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740017070 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74419d6c0 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7400054d0 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740004cf0 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.145+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7441a4fa0 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.146+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7441021b0 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.148+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa740004e90 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.148+0000 7fa73a7fc640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7300a3240 0x7fa7300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.148+0000 7fa7489e2640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7300a3240 0x7fa7300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.148+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fa7400cf280 con 0x7fa744100e20 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.149+0000 7fa7489e2640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7300a3240 0x7fa7300a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa734009230 tx=0x7fa7340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:01.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.151+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa74009bdf0 con 0x7fa744100e20 2024-09-19T07:06:01.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:01.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:01.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:01.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:01.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: Deploying daemon mds.h on smithi046 2024-09-19T07:06:01.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.78:6836/3493854055,v1:172.21.15.78:6837/3493854055] up:boot 2024-09-19T07:06:01.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: fsmap 7 up:standby 2024-09-19T07:06:01.227 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:01 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:06:01.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.364+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa744101200 con 0x7fa744100e20 2024-09-19T07:06:01.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:01.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.365 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: Deploying daemon mds.h on smithi046 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.78:6836/3493854055,v1:172.21.15.78:6837/3493854055] up:boot 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: fsmap 7 up:standby 2024-09-19T07:06:01.366 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:01 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:06:01.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.364+0000 7fa73a7fc640 1 -- 172.21.15.29:0/1500572450 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7fa744101200 con 0x7fa744100e20 2024-09-19T07:06:01.367 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:01.367 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":8,"btime":"2024-09-19T07:06:00:301904+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T07:06:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 8 2024-09-19T07:06:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.366+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7300a3240 msgr2=0x7fa7300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.366+0000 7fa74b447640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7300a3240 0x7fa7300a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa734009230 tx=0x7fa7340058d0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.366+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 msgr2=0x7fa744198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.366+0000 7fa74b447640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 0x7fa744198420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa74000d770 tx=0x7fa74000dc30 comp rx=0 tx=0).stop 2024-09-19T07:06:01.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 shutdown_connections 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7300a3240 0x7fa7300a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa744102ef0 0x7fa74419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa744102570 0x7fa744198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 --2- 172.21.15.29:0/1500572450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa744100e20 0x7fa744198420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 >> 172.21.15.29:0/1500572450 conn(0x7fa7440fc7d0 msgr2=0x7fa74406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 shutdown_connections 2024-09-19T07:06:01.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:01.367+0000 7fa74b447640 1 -- 172.21.15.29:0/1500572450 wait complete. 2024-09-19T07:06:01.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: Deploying daemon mds.h on smithi046 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.78:6836/3493854055,v1:172.21.15.78:6837/3493854055] up:boot 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: fsmap 7 up:standby 2024-09-19T07:06:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:01 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:06:02.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:02 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1500572450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:02.442 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:02 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1500572450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:02.442 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 systemd[1]: Starting Ceph mds.h for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:06:02.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:02 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1500572450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:02.723 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 podman[63361]: 2024-09-19 07:06:02.344383563 +0000 UTC m=+0.016482000 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:06:02.723 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 podman[63361]: 2024-09-19 07:06:02.47912933 +0000 UTC m=+0.151227794 container create 9718e73b2eaf075b92778f278a5ab8b13ce3f392032a76760c93ae1f1027df4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T07:06:02.723 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 podman[63361]: 2024-09-19 07:06:02.72333425 +0000 UTC m=+0.395432686 container init 9718e73b2eaf075b92778f278a5ab8b13ce3f392032a76760c93ae1f1027df4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T07:06:02.975 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 podman[63361]: 2024-09-19 07:06:02.726224503 +0000 UTC m=+0.398322933 container start 9718e73b2eaf075b92778f278a5ab8b13ce3f392032a76760c93ae1f1027df4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:06:02.975 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 ceph-mds[63380]: -- 172.21.15.46:0/184773604 <== mon.2 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555ebe325860 con 0x555ebe303000 2024-09-19T07:06:02.975 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h[63376]: starting mds.h at 2024-09-19T07:06:02.975 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 bash[63361]: 9718e73b2eaf075b92778f278a5ab8b13ce3f392032a76760c93ae1f1027df4d 2024-09-19T07:06:02.975 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:06:02 smithi046 systemd[1]: Started Ceph mds.h for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:06:03.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:03.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:03.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:04.099 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:04.372 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:04.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:04 smithi078 ceph-mon[34556]: Deploying daemon mds.i on smithi078 2024-09-19T07:06:04.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:04 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.46:6836/1039888184,v1:172.21.15.46:6837/1039888184] up:boot 2024-09-19T07:06:04.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:04 smithi078 ceph-mon[34556]: fsmap 8 up:standby 2024-09-19T07:06:04.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:04 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:06:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:04 smithi046 ceph-mon[34147]: Deploying daemon mds.i on smithi078 2024-09-19T07:06:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:04 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.46:6836/1039888184,v1:172.21.15.46:6837/1039888184] up:boot 2024-09-19T07:06:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:04 smithi046 ceph-mon[34147]: fsmap 8 up:standby 2024-09-19T07:06:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:04 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:06:04.493 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:04 smithi029 ceph-mon[31255]: Deploying daemon mds.i on smithi078 2024-09-19T07:06:04.493 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:04 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.46:6836/1039888184,v1:172.21.15.46:6837/1039888184] up:boot 2024-09-19T07:06:04.493 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:04 smithi029 ceph-mon[31255]: fsmap 8 up:standby 2024-09-19T07:06:04.493 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:04 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:06:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 -- 172.21.15.29:0/371777071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c102790 msgr2=0x7fcd4c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 --2- 172.21.15.29:0/371777071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c102790 0x7fcd4c1067e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009900 tx=0x7fcd3c02a410 comp rx=0 tx=0).stop 2024-09-19T07:06:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 -- 172.21.15.29:0/371777071 shutdown_connections 2024-09-19T07:06:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 --2- 172.21.15.29:0/371777071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd4c106f10 0x7fcd4c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 --2- 172.21.15.29:0/371777071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c102790 0x7fcd4c1067e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:04.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 --2- 172.21.15.29:0/371777071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd4c101de0 0x7fcd4c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 -- 172.21.15.29:0/371777071 >> 172.21.15.29:0/371777071 conn(0x7fcd4c0fd8c0 msgr2=0x7fcd4c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 -- 172.21.15.29:0/371777071 shutdown_connections 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.862+0000 7fcd54788640 1 -- 172.21.15.29:0/371777071 wait complete. 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 Processor -- start 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 -- start start 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 0x7fcd4c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd4c102790 0x7fcd4c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd4c106f10 0x7fcd4c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c111e70 con 0x7fcd4c101de0 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c111cf0 con 0x7fcd4c106f10 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd54788640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c111ff0 con 0x7fcd4c102790 2024-09-19T07:06:04.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd52524640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 0x7fcd4c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd52524640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 0x7fcd4c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:59490/0 (socket says 172.21.15.29:59490) 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd52524640 1 -- 172.21.15.29:0/3639580112 learned_addr learned my addr 172.21.15.29:0/3639580112 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.863+0000 7fcd51d23640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd4c102790 0x7fcd4c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52524640 1 -- 172.21.15.29:0/3639580112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd4c102790 msgr2=0x7fcd4c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52524640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd4c102790 0x7fcd4c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52524640 1 -- 172.21.15.29:0/3639580112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd4c106f10 msgr2=0x7fcd4c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52d25640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd4c106f10 0x7fcd4c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52524640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd4c106f10 0x7fcd4c19cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52524640 1 -- 172.21.15.29:0/3639580112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c19d340 con 0x7fcd4c101de0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd52524640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 0x7fcd4c198390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800d950 tx=0x7fcd4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48017070 con 0x7fcd4c101de0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c19d630 con 0x7fcd4c101de0 2024-09-19T07:06:04.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd48009c30 con 0x7fcd4c101de0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800f620 con 0x7fcd4c101de0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.864+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1a4f10 con 0x7fcd4c101de0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.865+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c1021c0 con 0x7fcd4c101de0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.866+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcd480109a0 con 0x7fcd4c101de0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.867+0000 7fcd437fe640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd380a3240 0x7fcd380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.867+0000 7fcd51d23640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd380a3240 0x7fcd380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.867+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fcd480cf0e0 con 0x7fcd4c101de0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.868+0000 7fcd51d23640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd380a3240 0x7fcd380a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005ab0 tx=0x7fcd3c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:04.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:04.871+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd48009de0 con 0x7fcd4c101de0 2024-09-19T07:06:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.083+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd4c1996f0 con 0x7fcd4c101de0 2024-09-19T07:06:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.084+0000 7fcd437fe640 1 -- 172.21.15.29:0/3639580112 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7fcd4809c200 con 0x7fcd4c101de0 2024-09-19T07:06:05.086 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:05.086 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":9,"btime":"2024-09-19T07:06:03:161088+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T07:06:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 9 2024-09-19T07:06:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.086+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd380a3240 msgr2=0x7fcd380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.086+0000 7fcd54788640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd380a3240 0x7fcd380a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c005ab0 tx=0x7fcd3c005a20 comp rx=0 tx=0).stop 2024-09-19T07:06:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.086+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 msgr2=0x7fcd4c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.086+0000 7fcd54788640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 0x7fcd4c198390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800d950 tx=0x7fcd4800de10 comp rx=0 tx=0).stop 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 shutdown_connections 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd4c106f10 0x7fcd4c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd380a3240 0x7fcd380a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd4c102790 0x7fcd4c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 --2- 172.21.15.29:0/3639580112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd4c101de0 0x7fcd4c198390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 >> 172.21.15.29:0/3639580112 conn(0x7fcd4c0fd8c0 msgr2=0x7fcd4c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 shutdown_connections 2024-09-19T07:06:05.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:05.087+0000 7fcd54788640 1 -- 172.21.15.29:0/3639580112 wait complete. 2024-09-19T07:06:05.174 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 podman[65166]: 2024-09-19 07:06:05.085040666 +0000 UTC m=+0.128669601 container create 0b9f4cc07f7d627b9ba89223a2104df8f91a7a174d8e129be6d53ca71ed6a9e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T07:06:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:05 smithi029 ceph-mon[31255]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:05 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3639580112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:05.429 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:05 smithi078 ceph-mon[34556]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:05.430 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:05 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3639580112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:05.430 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 podman[65166]: 2024-09-19 07:06:05.329760472 +0000 UTC m=+0.373389408 container init 0b9f4cc07f7d627b9ba89223a2104df8f91a7a174d8e129be6d53ca71ed6a9e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:06:05.430 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 podman[65166]: 2024-09-19 07:06:05.332587158 +0000 UTC m=+0.376216093 container start 0b9f4cc07f7d627b9ba89223a2104df8f91a7a174d8e129be6d53ca71ed6a9e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:06:05.430 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 ceph-mds[65185]: -- 172.21.15.78:0/2606023736 <== mon.1 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56034c15bc20 con 0x56034c139000 2024-09-19T07:06:05.430 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: starting mds.i at 2024-09-19T07:06:05.430 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 bash[65166]: 0b9f4cc07f7d627b9ba89223a2104df8f91a7a174d8e129be6d53ca71ed6a9e8 2024-09-19T07:06:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:05 smithi046 ceph-mon[34147]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:05 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3639580112' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:05.695 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:05 smithi078 systemd[1]: Started Ceph mds.i for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:06.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: Deploying daemon mds.g on smithi029 2024-09-19T07:06:06.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] up:boot 2024-09-19T07:06:06.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: fsmap 9 up:standby 2024-09-19T07:06:06.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:06:06.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: Deploying daemon mds.g on smithi029 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] up:boot 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: fsmap 9 up:standby 2024-09-19T07:06:06.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:06:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:06.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:06.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:06.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: Deploying daemon mds.g on smithi029 2024-09-19T07:06:06.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] up:boot 2024-09-19T07:06:06.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: fsmap 9 up:standby 2024-09-19T07:06:06.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:06:07.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:07 smithi029 ceph-mon[31255]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:07.624 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:07 smithi029 systemd[1]: Starting Ceph mds.g for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:06:07.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:07.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:07 smithi078 ceph-mon[34556]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:07 smithi046 ceph-mon[34147]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:08.001 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:07 smithi029 podman[72084]: 2024-09-19 07:06:07.61752411 +0000 UTC m=+0.016163237 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:06:08.001 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:07 smithi029 podman[72084]: 2024-09-19 07:06:07.743767801 +0000 UTC m=+0.142406916 container create 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:06:08.002 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:08 smithi029 podman[72084]: 2024-09-19 07:06:08.00050221 +0000 UTC m=+0.399141348 container init 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T07:06:08.200 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:08.324 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:08 smithi029 podman[72084]: 2024-09-19 07:06:08.004366216 +0000 UTC m=+0.403005337 container start 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T07:06:08.325 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:08 smithi029 ceph-mds[72133]: -- 172.21.15.29:0/1688899451 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557fe6a11860 con 0x557fe69ef000 2024-09-19T07:06:08.325 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g[72117]: starting mds.g at 2024-09-19T07:06:08.325 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:08 smithi029 bash[72084]: 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba 2024-09-19T07:06:08.325 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:06:08 smithi029 systemd[1]: Started Ceph mds.g for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:06:08.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 -- 172.21.15.29:0/446779723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec106f10 msgr2=0x7f7aec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/446779723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec106f10 0x7f7aec10ea90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009ca0 tx=0x7f7ae402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 -- 172.21.15.29:0/446779723 shutdown_connections 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/446779723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec106f10 0x7f7aec10ea90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/446779723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec102790 0x7f7aec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/446779723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec101de0 0x7f7aec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 -- 172.21.15.29:0/446779723 >> 172.21.15.29:0/446779723 conn(0x7f7aec0fd8c0 msgr2=0x7f7aec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 -- 172.21.15.29:0/446779723 shutdown_connections 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 -- 172.21.15.29:0/446779723 wait complete. 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 Processor -- start 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.726+0000 7f7af2fd6640 1 -- start start 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 0x7f7aec19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec102790 0x7f7aec19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec106f10 0x7f7aec19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec111e40 con 0x7f7aec101de0 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec111cc0 con 0x7f7aec106f10 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec111fc0 con 0x7f7aec102790 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 0x7f7aec19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 0x7f7aec19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44492/0 (socket says 172.21.15.29:44492) 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 -- 172.21.15.29:0/2177528598 learned_addr learned my addr 172.21.15.29:0/2177528598 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af1573640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec106f10 0x7f7aec19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7aebfff640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec102790 0x7f7aec19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 -- 172.21.15.29:0/2177528598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec102790 msgr2=0x7f7aec19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec102790 0x7f7aec19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 -- 172.21.15.29:0/2177528598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec106f10 msgr2=0x7f7aec19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec106f10 0x7f7aec19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 -- 172.21.15.29:0/2177528598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec19f4d0 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af1573640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec106f10 0x7f7aec19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af0d72640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 0x7f7aec19a520 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b4a0 tx=0x7f7ae000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0014070 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec19f7c0 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ae0010ac0 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.727+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0017c30 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.728+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec1a70a0 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.729+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aec1021c0 con 0x7f7aec101de0 2024-09-19T07:06:08.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.730+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7ae0017070 con 0x7f7aec101de0 2024-09-19T07:06:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.730+0000 7f7ae9ffb640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7adc0a3240 0x7f7adc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.730+0000 7f7aebfff640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7adc0a3240 0x7f7adc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.730+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f7ae00cec00 con 0x7f7aec101de0 2024-09-19T07:06:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.731+0000 7f7aebfff640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7adc0a3240 0x7f7adc0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005e10 tx=0x7f7ad8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:08.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.735+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ae00d5080 con 0x7f7aec101de0 2024-09-19T07:06:08.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.961+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7aec1a7270 con 0x7f7aec101de0 2024-09-19T07:06:08.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.962+0000 7f7ae9ffb640 1 -- 172.21.15.29:0/2177528598 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8860 (secure 0 0 0) 0x7f7ae009bdc0 con 0x7f7aec101de0 2024-09-19T07:06:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:08.964 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":11,"btime":"2024-09-19T07:06:08:490592+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:06:08.965 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 11 2024-09-19T07:06:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7adc0a3240 msgr2=0x7f7adc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7adc0a3240 0x7f7adc0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005e10 tx=0x7f7ad8005da0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 msgr2=0x7f7aec19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 0x7f7aec19a520 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000b4a0 tx=0x7f7ae000b960 comp rx=0 tx=0).stop 2024-09-19T07:06:08.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 shutdown_connections 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7aec106f10 0x7f7aec19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7adc0a3240 0x7f7adc0a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7aec102790 0x7f7aec19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 --2- 172.21.15.29:0/2177528598 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aec101de0 0x7f7aec19a520 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 >> 172.21.15.29:0/2177528598 conn(0x7f7aec0fd8c0 msgr2=0x7f7aec0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 shutdown_connections 2024-09-19T07:06:08.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:08.964+0000 7f7af2fd6640 1 -- 172.21.15.29:0/2177528598 wait complete. 2024-09-19T07:06:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: Deploying daemon mds.a on smithi029 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.29:6838/680020224,v1:172.21.15.29:6839/680020224] up:boot 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: fsmap 10 up:standby 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:06:09.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:09 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2177528598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:09.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: Deploying daemon mds.a on smithi029 2024-09-19T07:06:09.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.29:6838/680020224,v1:172.21.15.29:6839/680020224] up:boot 2024-09-19T07:06:09.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: fsmap 10 up:standby 2024-09-19T07:06:09.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:06:09.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:09 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2177528598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: Deploying daemon mds.a on smithi029 2024-09-19T07:06:09.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.29:6838/680020224,v1:172.21.15.29:6839/680020224] up:boot 2024-09-19T07:06:09.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: fsmap 10 up:standby 2024-09-19T07:06:09.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:06:09.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:09 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2177528598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:11.444 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:11 smithi029 ceph-mon[31255]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:11.444 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 systemd[1]: Starting Ceph mds.a for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:06:11.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:11 smithi046 ceph-mon[34147]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:11 smithi078 ceph-mon[34556]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:11.724 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 podman[72497]: 2024-09-19 07:06:11.496593292 +0000 UTC m=+0.016655564 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:06:11.725 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 podman[72497]: 2024-09-19 07:06:11.598827697 +0000 UTC m=+0.118889954 container create b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T07:06:11.960 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:11.986 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 podman[72497]: 2024-09-19 07:06:11.862186069 +0000 UTC m=+0.382248341 container init b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T07:06:11.986 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 podman[72497]: 2024-09-19 07:06:11.865223512 +0000 UTC m=+0.385285779 container start b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:06:11.986 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 ceph-mds[72516]: -- 172.21.15.29:0/3375497339 <== mon.0 v2:172.21.15.29:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b63db7860 con 0x559b63d95400 2024-09-19T07:06:11.986 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a[72512]: starting mds.a at 2024-09-19T07:06:11.986 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 bash[72497]: b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 2024-09-19T07:06:11.986 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:06:11 smithi029 systemd[1]: Started Ceph mds.a for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:06:12.227 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 -- 172.21.15.29:0/2843746730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4101270 msgr2=0x7f60f410df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/2843746730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4101270 0x7f60f410df30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009900 tx=0x7f60e802a410 comp rx=0 tx=0).stop 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 -- 172.21.15.29:0/2843746730 shutdown_connections 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/2843746730 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60f410e470 0x7f60f4110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/2843746730 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4101270 0x7f60f410df30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/2843746730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 0x7f60f4100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.710+0000 7f60fb4aa640 1 -- 172.21.15.29:0/2843746730 >> 172.21.15.29:0/2843746730 conn(0x7f60f40fc7d0 msgr2=0x7f60f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 -- 172.21.15.29:0/2843746730 shutdown_connections 2024-09-19T07:06:12.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 -- 172.21.15.29:0/2843746730 wait complete. 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 Processor -- start 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 -- start start 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 0x7f60f419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60f4101270 0x7f60f419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 0x7f60f419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f60f41140a0 con 0x7f60f410e470 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f60f4113f20 con 0x7f60f4101270 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60fb4aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f60f4114220 con 0x7f60f41008c0 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60f9a47640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 0x7f60f419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60f9a47640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 0x7f60f419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44530/0 (socket says 172.21.15.29:44530) 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.711+0000 7f60f9a47640 1 -- 172.21.15.29:0/1923943907 learned_addr learned my addr 172.21.15.29:0/1923943907 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:12.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f8a45640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60f4101270 0x7f60f419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9246640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 0x7f60f419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9a47640 1 -- 172.21.15.29:0/1923943907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 msgr2=0x7f60f419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9a47640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 0x7f60f419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9a47640 1 -- 172.21.15.29:0/1923943907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60f4101270 msgr2=0x7f60f419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9a47640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60f4101270 0x7f60f419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9a47640 1 -- 172.21.15.29:0/1923943907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f419f5f0 con 0x7f60f410e470 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9246640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 0x7f60f419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f9a47640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 0x7f60f419ef10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00d6a0 tx=0x7f60ec00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec017070 con 0x7f60f410e470 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60ec009820 con 0x7f60f410e470 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f419f8e0 con 0x7f60f410e470 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec004c40 con 0x7f60f410e470 2024-09-19T07:06:12.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.712+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f41a71c0 con 0x7f60f410e470 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.713+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f4100ca0 con 0x7f60f410e470 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.715+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f60ec0099d0 con 0x7f60f410e470 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.716+0000 7f60f27fc640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60dc0a32c0 0x7f60dc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.716+0000 7f60f9246640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60dc0a32c0 0x7f60dc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.716+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f60ec0cf1b0 con 0x7f60f410e470 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.716+0000 7f60f9246640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60dc0a32c0 0x7f60dc0a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60e4007eb0 tx=0x7f60e40073c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:12.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.719+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60ec09c350 con 0x7f60f410e470 2024-09-19T07:06:12.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.931+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60f4109600 con 0x7f60f410e470 2024-09-19T07:06:12.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.931+0000 7f60f27fc640 1 -- 172.21.15.29:0/1923943907 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f60ec09bc50 con 0x7f60f410e470 2024-09-19T07:06:12.934 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:12.934 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":12,"btime":"2024-09-19T07:06:12:206236+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:06:12.934 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 12 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60dc0a32c0 msgr2=0x7f60dc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60dc0a32c0 0x7f60dc0a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60e4007eb0 tx=0x7f60e40073c0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 msgr2=0x7f60f419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 0x7f60f419ef10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f60ec00d6a0 tx=0x7f60ec00db60 comp rx=0 tx=0).stop 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 shutdown_connections 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f410e470 0x7f60f419ef10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60f4101270 0x7f60f419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60dc0a32c0 0x7f60dc0a5780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 --2- 172.21.15.29:0/1923943907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60f41008c0 0x7f60f419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:12.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 >> 172.21.15.29:0/1923943907 conn(0x7f60f40fc7d0 msgr2=0x7f60f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:12.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 shutdown_connections 2024-09-19T07:06:12.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:12.934+0000 7f60fb4aa640 1 -- 172.21.15.29:0/1923943907 wait complete. 2024-09-19T07:06:13.305 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: Deploying daemon mds.b on smithi046 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.29:6840/2441165637,v1:172.21.15.29:6841/2441165637] up:boot 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: fsmap 11 up:standby 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:06:13.306 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:13 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1923943907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: Deploying daemon mds.b on smithi046 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.29:6840/2441165637,v1:172.21.15.29:6841/2441165637] up:boot 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: fsmap 11 up:standby 2024-09-19T07:06:13.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:06:13.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:13 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1923943907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:06:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:06:13.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:13.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: Deploying daemon mds.b on smithi046 2024-09-19T07:06:13.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.29:6840/2441165637,v1:172.21.15.29:6841/2441165637] up:boot 2024-09-19T07:06:13.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: fsmap 11 up:standby 2024-09-19T07:06:13.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:06:13.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:13 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1923943907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:14.225 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 systemd[1]: Starting Ceph mds.b for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:06:14.637 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 podman[63665]: 2024-09-19 07:06:14.254644933 +0000 UTC m=+0.016794085 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:06:14.637 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 podman[63665]: 2024-09-19 07:06:14.384553108 +0000 UTC m=+0.146702290 container create 82e462d0dd6a17e787a1990e013294d5d966f493d4da0932a4e60b8d60403c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T07:06:14.637 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 podman[63665]: 2024-09-19 07:06:14.637119428 +0000 UTC m=+0.399268569 container init 82e462d0dd6a17e787a1990e013294d5d966f493d4da0932a4e60b8d60403c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:06:14.975 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 podman[63665]: 2024-09-19 07:06:14.64031273 +0000 UTC m=+0.402461876 container start 82e462d0dd6a17e787a1990e013294d5d966f493d4da0932a4e60b8d60403c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T07:06:14.975 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 ceph-mds[63684]: -- 172.21.15.46:0/214071856 <== mon.2 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de445d7860 con 0x55de445b5400 2024-09-19T07:06:14.975 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b[63680]: starting mds.b at 2024-09-19T07:06:14.975 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 bash[63665]: 82e462d0dd6a17e787a1990e013294d5d966f493d4da0932a4e60b8d60403c4b 2024-09-19T07:06:14.975 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:06:14 smithi046 systemd[1]: Started Ceph mds.b for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:06:15.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:15.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:15.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:15.656 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:16.162 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:16 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.46:6838/865095783,v1:172.21.15.46:6839/865095783] up:boot 2024-09-19T07:06:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:16 smithi078 ceph-mon[34556]: fsmap 12 up:standby 2024-09-19T07:06:16.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:16 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:06:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:16 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.46:6838/865095783,v1:172.21.15.46:6839/865095783] up:boot 2024-09-19T07:06:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:16 smithi046 ceph-mon[34147]: fsmap 12 up:standby 2024-09-19T07:06:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:16 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:06:16.286 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:16 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.46:6838/865095783,v1:172.21.15.46:6839/865095783] up:boot 2024-09-19T07:06:16.286 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:16 smithi029 ceph-mon[31255]: fsmap 12 up:standby 2024-09-19T07:06:16.286 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:16 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:06:16.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 -- 172.21.15.29:0/3239861590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668103660 msgr2=0x7f966810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 --2- 172.21.15.29:0/3239861590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668103660 0x7f966810bb50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f965c009900 tx=0x7f965c02a480 comp rx=0 tx=0).stop 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 -- 172.21.15.29:0/3239861590 shutdown_connections 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 --2- 172.21.15.29:0/3239861590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f966810c170 0x7f966810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 --2- 172.21.15.29:0/3239861590 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668103660 0x7f966810bb50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 --2- 172.21.15.29:0/3239861590 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9668102d40 0x7f9668103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 -- 172.21.15.29:0/3239861590 >> 172.21.15.29:0/3239861590 conn(0x7f96680fc7a0 msgr2=0x7f96680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 -- 172.21.15.29:0/3239861590 shutdown_connections 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.633+0000 7f966df68640 1 -- 172.21.15.29:0/3239861590 wait complete. 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 Processor -- start 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 -- start start 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 0x7f9668198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9668103660 0x7f96681988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f966810c170 0x7f966819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9668111e70 con 0x7f9668102d40 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9668111cf0 con 0x7f9668103660 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f966df68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9668111ff0 con 0x7f966810c170 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 0x7f9668198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 0x7f9668198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50202/0 (socket says 172.21.15.29:50202) 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 -- 172.21.15.29:0/2818457774 learned_addr learned my addr 172.21.15.29:0/2818457774 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f9667fff640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f966810c170 0x7f966819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f9666ffd640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9668103660 0x7f96681988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 -- 172.21.15.29:0/2818457774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f966810c170 msgr2=0x7f966819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f966810c170 0x7f966819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 -- 172.21.15.29:0/2818457774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9668103660 msgr2=0x7f96681988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9668103660 0x7f96681988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.634+0000 7f96677fe640 1 -- 172.21.15.29:0/2818457774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966819d330 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.635+0000 7f96677fe640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 0x7f9668198380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f965800c890 tx=0x7f965800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.635+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658004220 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.635+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f96580043c0 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.635+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966819d620 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.635+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658004a00 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.635+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96681a4f00 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.636+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9668103120 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.637+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9658004ba0 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.638+0000 7f9664ff9640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96500a32c0 0x7f96500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.638+0000 7f9666ffd640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96500a32c0 0x7f96500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.638+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f96580cf110 con 0x7f9668102d40 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.638+0000 7f9666ffd640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96500a32c0 0x7f96500a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f965c000c00 tx=0x7f965c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:16.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.642+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9658014030 con 0x7f9668102d40 2024-09-19T07:06:16.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.886+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f966802d7c0 con 0x7f9668102d40 2024-09-19T07:06:16.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.887+0000 7f9664ff9640 1 -- 172.21.15.29:0/2818457774 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7f965809c270 con 0x7f9668102d40 2024-09-19T07:06:16.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:16.889 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":13,"btime":"2024-09-19T07:06:15:018154+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24499,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T07:06:16.889 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 13 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96500a32c0 msgr2=0x7f96500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96500a32c0 0x7f96500a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f965c000c00 tx=0x7f965c031400 comp rx=0 tx=0).stop 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 msgr2=0x7f9668198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 0x7f9668198380 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f965800c890 tx=0x7f965800cd50 comp rx=0 tx=0).stop 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 shutdown_connections 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f96500a32c0 0x7f96500a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f966810c170 0x7f966819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9668103660 0x7f96681988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 --2- 172.21.15.29:0/2818457774 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9668102d40 0x7f9668198380 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 >> 172.21.15.29:0/2818457774 conn(0x7f96680fc7a0 msgr2=0x7f96680fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 shutdown_connections 2024-09-19T07:06:16.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:16.889+0000 7f966df68640 1 -- 172.21.15.29:0/2818457774 wait complete. 2024-09-19T07:06:17.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:17 smithi029 ceph-mon[31255]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:17.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:17 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:17 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:17 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:17 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.558 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:17 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2818457774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:17.592 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T07:06:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:17 smithi078 ceph-mon[34556]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:17 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:17 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:17 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:17 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:17 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2818457774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:17 smithi046 ceph-mon[34147]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:17 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:17 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:17 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:17 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:17.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:17 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2818457774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:17.858 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:18.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 -- 172.21.15.29:0/1056868489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 msgr2=0x7fcb6c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 --2- 172.21.15.29:0/1056868489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c107b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009930 tx=0x7fcb6002a420 comp rx=0 tx=0).stop 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 -- 172.21.15.29:0/1056868489 shutdown_connections 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 --2- 172.21.15.29:0/1056868489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6c1082a0 0x7fcb6c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 --2- 172.21.15.29:0/1056868489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c107b90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 --2- 172.21.15.29:0/1056868489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 0x7fcb6c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 -- 172.21.15.29:0/1056868489 >> 172.21.15.29:0/1056868489 conn(0x7fcb6c0fc7d0 msgr2=0x7fcb6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 -- 172.21.15.29:0/1056868489 shutdown_connections 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.347+0000 7fcb70866640 1 -- 172.21.15.29:0/1056868489 wait complete. 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 Processor -- start 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 -- start start 2024-09-19T07:06:18.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 0x7fcb6c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6c1082a0 0x7fcb6c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c111f50 con 0x7fcb6c1036e0 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c111dd0 con 0x7fcb6c102d30 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb70866640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1120d0 con 0x7fcb6c1082a0 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb69d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 0x7fcb6c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb69d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50224/0 (socket says 172.21.15.29:50224) 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb69d9b640 1 -- 172.21.15.29:0/994570324 learned_addr learned my addr 172.21.15.29:0/994570324 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.348+0000 7fcb6ad9d640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6c1082a0 0x7fcb6c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb69d9b640 1 -- 172.21.15.29:0/994570324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6c1082a0 msgr2=0x7fcb6c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:18.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb69d9b640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6c1082a0 0x7fcb6c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb69d9b640 1 -- 172.21.15.29:0/994570324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 msgr2=0x7fcb6c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb69d9b640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 0x7fcb6c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb69d9b640 1 -- 172.21.15.29:0/994570324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c19d4c0 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb6a59c640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 0x7fcb6c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb69d9b640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c198a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb60004770 tx=0x7fcb60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6003f030 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcb600318a0 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60035070 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c19d750 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.349+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1a5090 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.350+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c103110 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.351+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcb60042030 con 0x7fcb6c1036e0 2024-09-19T07:06:18.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.352+0000 7fcb5b7fe640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcb540a32c0 0x7fcb540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.352+0000 7fcb6a59c640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcb540a32c0 0x7fcb540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.353+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fcb600ef870 con 0x7fcb6c1036e0 2024-09-19T07:06:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.353+0000 7fcb6a59c640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcb540a32c0 0x7fcb540a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009fc0 tx=0x7fcb5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:18.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.357+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb600bc3e0 con 0x7fcb6c1036e0 2024-09-19T07:06:18.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.557+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcb6c10a2b0 con 0x7fcb6c1036e0 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.557+0000 7fcb5b7fe640 1 -- 172.21.15.29:0/994570324 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fcb600c06e0 con 0x7fcb6c1036e0 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout:[ 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "poolnum": 1, 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: "poolname": ".mgr" 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:06:18.559 INFO:teuthology.orchestra.run.smithi029.stdout:] 2024-09-19T07:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcb540a32c0 msgr2=0x7fcb540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcb540a32c0 0x7fcb540a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009fc0 tx=0x7fcb5c005f90 comp rx=0 tx=0).stop 2024-09-19T07:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 msgr2=0x7fcb6c198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c198a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcb60004770 tx=0x7fcb60004270 comp rx=0 tx=0).stop 2024-09-19T07:06:18.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 shutdown_connections 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcb540a32c0 0x7fcb540a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb6c1082a0 0x7fcb6c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb6c1036e0 0x7fcb6c198a50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 --2- 172.21.15.29:0/994570324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb6c102d30 0x7fcb6c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 >> 172.21.15.29:0/994570324 conn(0x7fcb6c0fc7d0 msgr2=0x7fcb6c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.559+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 shutdown_connections 2024-09-19T07:06:18.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:18.560+0000 7fcb70866640 1 -- 172.21.15.29:0/994570324 wait complete. 2024-09-19T07:06:18.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:18.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:18.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:18.875 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:18 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/994570324' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:06:18.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:18.901 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:18.902 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.902 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:18.902 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:18 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/994570324' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:06:18.910 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.910 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.910 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:18.911 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:18.911 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:18.911 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:18.911 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:18 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/994570324' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:06:19.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:19 smithi029 ceph-mon[31255]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:19.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:19 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:19.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:19 smithi078 ceph-mon[34556]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:19.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:19 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:19.969 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T07:06:19.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T07:06:19.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:19 smithi046 ceph-mon[34147]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:19.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:19 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.276 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:20.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.680 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:20.681 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:20 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 -- 172.21.15.29:0/1113701413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090112b90 msgr2=0x7f8090114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 --2- 172.21.15.29:0/1113701413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090112b90 0x7f8090114f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8088009ca0 tx=0x7f808802a950 comp rx=0 tx=0).stop 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 -- 172.21.15.29:0/1113701413 shutdown_connections 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 --2- 172.21.15.29:0/1113701413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090112b90 0x7f8090114f80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 --2- 172.21.15.29:0/1113701413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8090074eb0 0x7f8090112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 --2- 172.21.15.29:0/1113701413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8090074590 0x7f8090074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.765+0000 7f8097875640 1 -- 172.21.15.29:0/1113701413 >> 172.21.15.29:0/1113701413 conn(0x7f80900fd8c0 msgr2=0x7f80900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:20.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.766+0000 7f8097875640 1 -- 172.21.15.29:0/1113701413 shutdown_connections 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.766+0000 7f8097875640 1 -- 172.21.15.29:0/1113701413 wait complete. 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.766+0000 7f8097875640 1 Processor -- start 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.766+0000 7f8097875640 1 -- start start 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8097875640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 0x7f80901a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8097875640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8090074eb0 0x7f80901a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8097875640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8090112b90 0x7f809019e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8097875640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8090118410 con 0x7f8090074590 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8097875640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8090118290 con 0x7f8090112b90 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8097875640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8090118590 con 0x7f8090074eb0 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 0x7f80901a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 0x7f80901a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50246/0 (socket says 172.21.15.29:50246) 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 -- 172.21.15.29:0/3623385214 learned_addr learned my addr 172.21.15.29:0/3623385214 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:20.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8094e10640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8090074eb0 0x7f80901a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095e12640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8090112b90 0x7f809019e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 -- 172.21.15.29:0/3623385214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8090074eb0 msgr2=0x7f80901a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8090074eb0 0x7f80901a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 -- 172.21.15.29:0/3623385214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8090112b90 msgr2=0x7f809019e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8090112b90 0x7f809019e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 -- 172.21.15.29:0/3623385214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809019ef60 con 0x7f8090074590 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.767+0000 7f8095611640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 0x7f80901a4640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c970 tx=0x7f808c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.768+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c007bb0 con 0x7f8090074590 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.768+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f808c007d50 con 0x7f8090074590 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.768+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809019f250 con 0x7f8090074590 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.768+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c00f450 con 0x7f8090074590 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.768+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80901ab4a0 con 0x7f8090074590 2024-09-19T07:06:20.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.769+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8090075cd0 con 0x7f8090074590 2024-09-19T07:06:20.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.770+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f808c004f00 con 0x7f8090074590 2024-09-19T07:06:20.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.770+0000 7f80867fc640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f807c0a32c0 0x7f807c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:20.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.771+0000 7f8094e10640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f807c0a32c0 0x7f807c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:20.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.771+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f808c0cf4c0 con 0x7f8090074590 2024-09-19T07:06:20.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.771+0000 7f8094e10640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f807c0a32c0 0x7f807c0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80901000e0 tx=0x7f808000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:20.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.774+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f808c014030 con 0x7f8090074590 2024-09-19T07:06:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:20.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:20.947 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:20 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:20.953+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8090074970 con 0x7f8090074590 2024-09-19T07:06:20.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:20.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:20.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:20.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:20 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:06:21.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.648+0000 7f80867fc640 1 -- 172.21.15.29:0/3623385214 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f808c09c0b0 con 0x7f8090074590 2024-09-19T07:06:21.649 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' created 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f807c0a32c0 msgr2=0x7f807c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f807c0a32c0 0x7f807c0a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80901000e0 tx=0x7f808000b390 comp rx=0 tx=0).stop 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 msgr2=0x7f80901a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 0x7f80901a4640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c970 tx=0x7f808c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 shutdown_connections 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8090112b90 0x7f809019e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f807c0a32c0 0x7f807c0a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8090074eb0 0x7f80901a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 --2- 172.21.15.29:0/3623385214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8090074590 0x7f80901a4640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 >> 172.21.15.29:0/3623385214 conn(0x7f80900fd8c0 msgr2=0x7f80900ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 shutdown_connections 2024-09-19T07:06:21.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:21.652+0000 7f8097875640 1 -- 172.21.15.29:0/3623385214 wait complete. 2024-09-19T07:06:21.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:21 smithi078 ceph-mon[34556]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:21.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:21 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3623385214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:06:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:21 smithi046 ceph-mon[34147]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:21 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3623385214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:06:22.028 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:21 smithi029 ceph-mon[31255]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:22.029 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:21 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3623385214' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:06:22.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T07:06:22.646 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:22.914 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:22 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3623385214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:06:22.914 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:22 smithi029 ceph-mon[31255]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:06:22.914 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:22 smithi029 ceph-mon[31255]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:06:22.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:22 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3623385214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:06:22.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:22 smithi078 ceph-mon[34556]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:06:22.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:22 smithi078 ceph-mon[34556]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:06:22.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:22 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3623385214' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:06:22.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:22 smithi046 ceph-mon[34147]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:06:22.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:22 smithi046 ceph-mon[34147]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.138+0000 7f5beadaa640 1 -- 172.21.15.29:0/812771399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 msgr2=0x7f5be410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.138+0000 7f5beadaa640 1 --2- 172.21.15.29:0/812771399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be410d950 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009cd0 tx=0x7f5bdc02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 -- 172.21.15.29:0/812771399 shutdown_connections 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 --2- 172.21.15.29:0/812771399 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be410d950 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 --2- 172.21.15.29:0/812771399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 0x7f5be4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 --2- 172.21.15.29:0/812771399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5be4106a80 0x7f5be4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 -- 172.21.15.29:0/812771399 >> 172.21.15.29:0/812771399 conn(0x7f5be40fc7a0 msgr2=0x7f5be40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 -- 172.21.15.29:0/812771399 shutdown_connections 2024-09-19T07:06:23.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 -- 172.21.15.29:0/812771399 wait complete. 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 Processor -- start 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 -- start start 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 0x7f5be4199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.139+0000 7f5beadaa640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be4199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5beadaa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5be4106a80 0x7f5be41a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5beadaa640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4110d30 con 0x7f5be4101420 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5beadaa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4110bb0 con 0x7f5be4106a80 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5beadaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4110eb0 con 0x7f5be4100a80 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be4199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be4199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50264/0 (socket says 172.21.15.29:50264) 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 -- 172.21.15.29:0/2745925021 learned_addr learned my addr 172.21.15.29:0/2745925021 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be9347640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5be4106a80 0x7f5be41a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:23.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be8b46640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 0x7f5be4199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 -- 172.21.15.29:0/2745925021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 msgr2=0x7f5be4199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 0x7f5be4199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 -- 172.21.15.29:0/2745925021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5be4106a80 msgr2=0x7f5be41a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5be4106a80 0x7f5be41a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 -- 172.21.15.29:0/2745925021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be41a46c0 con 0x7f5be4101420 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be8b46640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 0x7f5be4199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be3fff640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be4199640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000c920 tx=0x7f5bd000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0007c70 con 0x7f5be4101420 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be41a4890 con 0x7f5be4101420 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5bd0007e10 con 0x7f5be4101420 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.140+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0018820 con 0x7f5be4101420 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.141+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be41a4dd0 con 0x7f5be4101420 2024-09-19T07:06:23.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.142+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be4100ee0 con 0x7f5be4101420 2024-09-19T07:06:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.143+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5bd00189c0 con 0x7f5be4101420 2024-09-19T07:06:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.143+0000 7f5be1ffb640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5bd40a3240 0x7f5bd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.143+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f5bd00cf710 con 0x7f5be4101420 2024-09-19T07:06:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.144+0000 7f5be8b46640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5bd40a3240 0x7f5bd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.144+0000 7f5be8b46640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5bd40a3240 0x7f5bd40a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005fd0 tx=0x7f5bd80094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:23.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.148+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bd0014030 con 0x7f5be4101420 2024-09-19T07:06:23.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.327+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f5be4108ff0 con 0x7f5be4101420 2024-09-19T07:06:23.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.759+0000 7f5be1ffb640 1 -- 172.21.15.29:0/2745925021 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v80) ==== 171+0+0 (secure 0 0 0) 0x7f5bd009c760 con 0x7f5be4101420 2024-09-19T07:06:23.761 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' created 2024-09-19T07:06:23.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5bd40a3240 msgr2=0x7f5bd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5bd40a3240 0x7f5bd40a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8005fd0 tx=0x7f5bd80094d0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 msgr2=0x7f5be4199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be4199640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000c920 tx=0x7f5bd000cde0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 shutdown_connections 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5be4106a80 0x7f5be41a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5be4101420 0x7f5be4199640 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5bd40a3240 0x7f5bd40a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 --2- 172.21.15.29:0/2745925021 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5be4100a80 0x7f5be4199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:23.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 >> 172.21.15.29:0/2745925021 conn(0x7f5be40fc7a0 msgr2=0x7f5be40fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:23.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 shutdown_connections 2024-09-19T07:06:23.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:23.762+0000 7f5beadaa640 1 -- 172.21.15.29:0/2745925021 wait complete. 2024-09-19T07:06:24.112 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:23 smithi078 ceph-mon[34556]: pgmap v282: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:24.112 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:23 smithi078 ceph-mon[34556]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:06:24.112 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:23 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2745925021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T07:06:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:23 smithi029 ceph-mon[31255]: pgmap v282: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:23 smithi029 ceph-mon[31255]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:06:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:23 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2745925021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T07:06:24.163 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:23 smithi046 ceph-mon[34147]: pgmap v282: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:24.163 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:23 smithi046 ceph-mon[34147]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:06:24.163 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:23 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2745925021' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T07:06:24.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T07:06:24.765 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:25.043 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:24 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2745925021' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T07:06:25.043 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:24 smithi029 ceph-mon[31255]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:06:25.043 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:24 smithi029 ceph-mon[31255]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:06:25.070 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:24 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2745925021' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T07:06:25.070 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:24 smithi078 ceph-mon[34556]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:06:25.070 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:24 smithi078 ceph-mon[34556]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:06:25.183 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:24 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2745925021' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T07:06:25.183 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:24 smithi046 ceph-mon[34147]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:06:25.184 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:24 smithi046 ceph-mon[34147]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 -- 172.21.15.29:0/2447905645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438101430 msgr2=0x7f843810d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 --2- 172.21.15.29:0/2447905645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438101430 0x7f843810d960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8430009cd0 tx=0x7f843002a8f0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 -- 172.21.15.29:0/2447905645 shutdown_connections 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 --2- 172.21.15.29:0/2447905645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438101430 0x7f843810d960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 --2- 172.21.15.29:0/2447905645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8438100a90 0x7f8438100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 --2- 172.21.15.29:0/2447905645 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438106a90 0x7f8438106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 -- 172.21.15.29:0/2447905645 >> 172.21.15.29:0/2447905645 conn(0x7f84380fc7d0 msgr2=0x7f84380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:25.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 -- 172.21.15.29:0/2447905645 shutdown_connections 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.265+0000 7f843f869640 1 -- 172.21.15.29:0/2447905645 wait complete. 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 Processor -- start 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 -- start start 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8438100a90 0x7f8438102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 0x7f8438102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438106a90 0x7f84381030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110d40 con 0x7f8438101430 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110bc0 con 0x7f8438100a90 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843f869640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8438110ec0 con 0x7f8438106a90 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843ce04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 0x7f8438102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843ce04640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 0x7f8438102ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50278/0 (socket says 172.21.15.29:50278) 2024-09-19T07:06:25.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.266+0000 7f843ce04640 1 -- 172.21.15.29:0/701045312 learned_addr learned my addr 172.21.15.29:0/701045312 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843de06640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438106a90 0x7f84381030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843d605640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8438100a90 0x7f8438102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843ce04640 1 -- 172.21.15.29:0/701045312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438106a90 msgr2=0x7f84381030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843ce04640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438106a90 0x7f84381030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843ce04640 1 -- 172.21.15.29:0/701045312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8438100a90 msgr2=0x7f8438102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843ce04640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8438100a90 0x7f8438102660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843ce04640 1 -- 172.21.15.29:0/701045312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84381a67f0 con 0x7f8438101430 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843ce04640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 0x7f8438102ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f842800e9f0 tx=0x7f842800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842800cd80 con 0x7f8438101430 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84280108e0 con 0x7f8438101430 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84381a6ae0 con 0x7f8438101430 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.267+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428018920 con 0x7f8438101430 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.268+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84381a7020 con 0x7f8438101430 2024-09-19T07:06:25.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.269+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8438100ef0 con 0x7f8438101430 2024-09-19T07:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.270+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8428010a90 con 0x7f8438101430 2024-09-19T07:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.271+0000 7f842e7fc640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f84240a3240 0x7f84240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.271+0000 7f843d605640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f84240a3240 0x7f84240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.271+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7f84280cfb80 con 0x7f8438101430 2024-09-19T07:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.271+0000 7f843d605640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f84240a3240 0x7f84240a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8434009af0 tx=0x7f8434005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:25.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.275+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f842809c9b0 con 0x7f8438101430 2024-09-19T07:06:25.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.491+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f84381a72c0 con 0x7f8438101430 2024-09-19T07:06:25.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.799+0000 7f842e7fc640 1 -- 172.21.15.29:0/701045312 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8428096e20 con 0x7f8438101430 2024-09-19T07:06:25.801 INFO:teuthology.orchestra.run.smithi029.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T07:06:25.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.801+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f84240a3240 msgr2=0x7f84240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.801+0000 7f843f869640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f84240a3240 0x7f84240a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8434009af0 tx=0x7f8434005f90 comp rx=0 tx=0).stop 2024-09-19T07:06:25.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.801+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 msgr2=0x7f8438102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.801+0000 7f843f869640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 0x7f8438102ba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f842800e9f0 tx=0x7f842800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 shutdown_connections 2024-09-19T07:06:25.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f84240a3240 0x7f84240a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8438106a90 0x7f84381030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8438101430 0x7f8438102ba0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 --2- 172.21.15.29:0/701045312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8438100a90 0x7f8438102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 >> 172.21.15.29:0/701045312 conn(0x7f84380fc7d0 msgr2=0x7f843806a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 shutdown_connections 2024-09-19T07:06:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:25.802+0000 7f843f869640 1 -- 172.21.15.29:0/701045312 wait complete. 2024-09-19T07:06:26.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:25 smithi029 ceph-mon[31255]: pgmap v285: 97 pgs: 9 creating+peering, 84 unknown, 4 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:26.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:25 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/701045312' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:06:26.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:25 smithi029 ceph-mon[31255]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:06:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:25 smithi078 ceph-mon[34556]: pgmap v285: 97 pgs: 9 creating+peering, 84 unknown, 4 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:25 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/701045312' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:06:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:25 smithi078 ceph-mon[34556]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:06:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:25 smithi046 ceph-mon[34147]: pgmap v285: 97 pgs: 9 creating+peering, 84 unknown, 4 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:25 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/701045312' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:06:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:25 smithi046 ceph-mon[34147]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T07:06:26.534 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T07:06:26.535 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T07:06:26.794 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:27.048 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:26 smithi029 ceph-mon[31255]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:06:27.048 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:26 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/701045312' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:06:27.048 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:26 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:06:27.048 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:26 smithi029 ceph-mon[31255]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:06:27.048 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:26 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] up:active 2024-09-19T07:06:27.048 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:26 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:06:27.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:26 smithi078 ceph-mon[34556]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:06:27.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:26 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/701045312' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:06:27.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:26 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:06:27.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:26 smithi078 ceph-mon[34556]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:06:27.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:26 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] up:active 2024-09-19T07:06:27.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:26 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:06:27.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:26 smithi046 ceph-mon[34147]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:06:27.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:26 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/701045312' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:06:27.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:26 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T07:06:27.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:26 smithi046 ceph-mon[34147]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T07:06:27.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:26 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] up:active 2024-09-19T07:06:27.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:26 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:06:27.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 -- 172.21.15.29:0/729165186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 msgr2=0x7f1dac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/729165186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac1029b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009900 tx=0x7f1d9c02a480 comp rx=0 tx=0).stop 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 -- 172.21.15.29:0/729165186 shutdown_connections 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/729165186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac102ef0 0x7f1dac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/729165186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac1029b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/729165186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac100e20 0x7f1dac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 -- 172.21.15.29:0/729165186 >> 172.21.15.29:0/729165186 conn(0x7f1dac0fc7d0 msgr2=0x7f1dac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 -- 172.21.15.29:0/729165186 shutdown_connections 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.269+0000 7f1db0fd2640 1 -- 172.21.15.29:0/729165186 wait complete. 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 Processor -- start 2024-09-19T07:06:27.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 -- start start 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac100e20 0x7f1dac197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac102ef0 0x7f1dac19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac110e30 con 0x7f1dac102570 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac110cb0 con 0x7f1dac102ef0 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1db0fd2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac110fb0 con 0x7f1dac100e20 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1da9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1da9d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45806/0 (socket says 172.21.15.29:45806) 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.270+0000 7f1da9d9b640 1 -- 172.21.15.29:0/3698947857 learned_addr learned my addr 172.21.15.29:0/3698947857 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1daa59c640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac100e20 0x7f1dac197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1daad9d640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac102ef0 0x7f1dac19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da9d9b640 1 -- 172.21.15.29:0/3698947857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac100e20 msgr2=0x7f1dac197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da9d9b640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac100e20 0x7f1dac197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da9d9b640 1 -- 172.21.15.29:0/3698947857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac102ef0 msgr2=0x7f1dac19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da9d9b640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac102ef0 0x7f1dac19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da9d9b640 1 -- 172.21.15.29:0/3698947857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac19c2e0 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1daad9d640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac102ef0 0x7f1dac19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da9d9b640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac197870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c006010 tx=0x7f1d9c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c046070 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d9c003aa0 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c035050 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac19c570 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.271+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac069f70 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.272+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac1021b0 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.274+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d9c049070 con 0x7f1dac102570 2024-09-19T07:06:27.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.274+0000 7f1da37fe640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1d980a3240 0x7f1d980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.274+0000 7f1daa59c640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1d980a3240 0x7f1d980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.275+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f1d9c0f1480 con 0x7f1dac102570 2024-09-19T07:06:27.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.275+0000 7f1daa59c640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1d980a3240 0x7f1d980a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d94005d00 tx=0x7f1d9400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:27.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.278+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d9c07e210 con 0x7f1dac102570 2024-09-19T07:06:27.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.464+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f1dac198690 con 0x7f1dac102570 2024-09-19T07:06:27.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.802+0000 7f1da37fe640 1 -- 172.21.15.29:0/3698947857 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v83) ==== 157+0+0 (secure 0 0 0) 0x7f1d9c0be2f0 con 0x7f1dac102570 2024-09-19T07:06:27.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.804+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1d980a3240 msgr2=0x7f1d980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.804+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1d980a3240 0x7f1d980a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1d94005d00 tx=0x7f1d9400b410 comp rx=0 tx=0).stop 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.804+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 msgr2=0x7f1dac197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.804+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac197870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c006010 tx=0x7f1d9c004270 comp rx=0 tx=0).stop 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 shutdown_connections 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1dac102ef0 0x7f1dac19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1dac102570 0x7f1dac197870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1d980a3240 0x7f1d980a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 --2- 172.21.15.29:0/3698947857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1dac100e20 0x7f1dac197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 >> 172.21.15.29:0/3698947857 conn(0x7f1dac0fc7d0 msgr2=0x7f1dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 shutdown_connections 2024-09-19T07:06:27.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:27.805+0000 7f1db0fd2640 1 -- 172.21.15.29:0/3698947857 wait complete. 2024-09-19T07:06:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:27 smithi029 ceph-mon[31255]: pgmap v288: 97 pgs: 34 creating+peering, 32 unknown, 31 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:27 smithi029 ceph-mon[31255]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:06:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:27 smithi029 ceph-mon[31255]: Cluster is now healthy 2024-09-19T07:06:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:27 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3698947857' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T07:06:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:27 smithi078 ceph-mon[34556]: pgmap v288: 97 pgs: 34 creating+peering, 32 unknown, 31 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:28.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:27 smithi078 ceph-mon[34556]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:06:28.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:27 smithi078 ceph-mon[34556]: Cluster is now healthy 2024-09-19T07:06:28.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:27 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3698947857' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T07:06:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:27 smithi046 ceph-mon[34147]: pgmap v288: 97 pgs: 34 creating+peering, 32 unknown, 31 active+clean; 577 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:27 smithi046 ceph-mon[34147]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:06:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:27 smithi046 ceph-mon[34147]: Cluster is now healthy 2024-09-19T07:06:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:27 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3698947857' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T07:06:28.603 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T07:06:28.865 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:28.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:28 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3698947857' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T07:06:28.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:28 smithi029 ceph-mon[31255]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:06:29.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:28 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3698947857' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T07:06:29.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:28 smithi078 ceph-mon[34556]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:06:29.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:28 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3698947857' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T07:06:29.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:28 smithi046 ceph-mon[34147]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:06:29.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 -- 172.21.15.29:0/253128377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c010c170 msgr2=0x7f99c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/253128377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c010c170 0x7f99c010e610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009ca0 tx=0x7f99b802a950 comp rx=0 tx=0).stop 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 -- 172.21.15.29:0/253128377 shutdown_connections 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/253128377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c010c170 0x7f99c010e610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/253128377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c0103660 0x7f99c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/253128377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 0x7f99c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 -- 172.21.15.29:0/253128377 >> 172.21.15.29:0/253128377 conn(0x7f99c00fc7a0 msgr2=0x7f99c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 -- 172.21.15.29:0/253128377 shutdown_connections 2024-09-19T07:06:29.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.342+0000 7f99c6e4c640 1 -- 172.21.15.29:0/253128377 wait complete. 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 Processor -- start 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 -- start start 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 0x7f99c0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 0x7f99c01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c010c170 0x7f99c019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0111e00 con 0x7f99c0103660 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0111c80 con 0x7f99c0102d40 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99c6e4c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0111f80 con 0x7f99c010c170 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 0x7f99c01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:29.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 0x7f99c01987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45812/0 (socket says 172.21.15.29:45812) 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.343+0000 7f99bffff640 1 -- 172.21.15.29:0/79288650 learned_addr learned my addr 172.21.15.29:0/79288650 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99c4be8640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 0x7f99c0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99c53e9640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c010c170 0x7f99c019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bffff640 1 -- 172.21.15.29:0/79288650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c010c170 msgr2=0x7f99c019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bffff640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c010c170 0x7f99c019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bffff640 1 -- 172.21.15.29:0/79288650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 msgr2=0x7f99c0198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bffff640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 0x7f99c0198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:29.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bffff640 1 -- 172.21.15.29:0/79288650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c019d230 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99c4be8640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 0x7f99c0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bffff640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 0x7f99c01987c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c970 tx=0x7f99ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac007bb0 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99ac007d50 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ac004e10 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.344+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c019d520 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.345+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c01a4e00 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.346+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c0103120 con 0x7f99c0103660 2024-09-19T07:06:29.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.347+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f99ac005000 con 0x7f99c0103660 2024-09-19T07:06:29.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.347+0000 7f99bdffb640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f99b00a32c0 0x7f99b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:29.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.348+0000 7f99c4be8640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f99b00a32c0 0x7f99b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:29.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.348+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8277+0+0 (secure 0 0 0) 0x7f99ac0cfa70 con 0x7f99c0103660 2024-09-19T07:06:29.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.348+0000 7f99c4be8640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f99b00a32c0 0x7f99b00a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99b400abe0 tx=0x7f99b400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:29.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.351+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99ac014030 con 0x7f99c0103660 2024-09-19T07:06:29.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:29.527+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f99c002d7c0 con 0x7f99c0103660 2024-09-19T07:06:30.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:30 smithi029 ceph-mon[31255]: pgmap v290: 97 pgs: 25 creating+peering, 9 unknown, 63 active+clean; 579 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-19T07:06:30.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:30 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/79288650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:06:30.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:30 smithi078 ceph-mon[34556]: pgmap v290: 97 pgs: 25 creating+peering, 9 unknown, 63 active+clean; 579 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-19T07:06:30.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:30 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/79288650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:06:30.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:30 smithi046 ceph-mon[34147]: pgmap v290: 97 pgs: 25 creating+peering, 9 unknown, 63 active+clean; 579 KiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-09-19T07:06:30.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:30 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/79288650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:06:30.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.814+0000 7f99bdffb640 1 -- 172.21.15.29:0/79288650 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v85) ==== 228+0+0 (secure 0 0 0) 0x7f99ac09c7e0 con 0x7f99c0103660 2024-09-19T07:06:30.815 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' created 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f99b00a32c0 msgr2=0x7f99b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f99b00a32c0 0x7f99b00a5780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f99b400abe0 tx=0x7f99b400a5c0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 msgr2=0x7f99c01987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 0x7f99c01987c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c970 tx=0x7f99ac00ce30 comp rx=0 tx=0).stop 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 shutdown_connections 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f99b00a32c0 0x7f99b00a5780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99c010c170 0x7f99c019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f99c0103660 0x7f99c01987c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 --2- 172.21.15.29:0/79288650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f99c0102d40 0x7f99c0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 >> 172.21.15.29:0/79288650 conn(0x7f99c00fc7a0 msgr2=0x7f99c00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:30.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 shutdown_connections 2024-09-19T07:06:30.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:30.818+0000 7f99c6e4c640 1 -- 172.21.15.29:0/79288650 wait complete. 2024-09-19T07:06:31.445 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:06:31 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: 2024-09-19T07:06:31.181+0000 7f374f527640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T07:06:31.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:31 smithi078 ceph-mon[34556]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 8 op/s 2024-09-19T07:06:31.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:31 smithi078 ceph-mon[34556]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:06:31.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:31 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/79288650' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:06:31.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:31 smithi078 ceph-mon[34556]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:06:31.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:31 smithi029 ceph-mon[31255]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 8 op/s 2024-09-19T07:06:31.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:31 smithi029 ceph-mon[31255]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:06:31.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:31 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/79288650' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:06:31.514 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:31 smithi029 ceph-mon[31255]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:06:31.546 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T07:06:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:31 smithi046 ceph-mon[34147]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 8 op/s 2024-09-19T07:06:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:31 smithi046 ceph-mon[34147]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:06:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:31 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/79288650' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:06:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:31 smithi046 ceph-mon[34147]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:06:31.807 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:32.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 -- 172.21.15.29:0/1392579770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8103780 msgr2=0x7f54d8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:32.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 --2- 172.21.15.29:0/1392579770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8103780 0x7f54d8107bc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009930 tx=0x7f54c002a420 comp rx=0 tx=0).stop 2024-09-19T07:06:32.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 -- 172.21.15.29:0/1392579770 shutdown_connections 2024-09-19T07:06:32.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 --2- 172.21.15.29:0/1392579770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8108300 0x7f54d810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 --2- 172.21.15.29:0/1392579770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8103780 0x7f54d8107bc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 --2- 172.21.15.29:0/1392579770 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d8102dd0 0x7f54d81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 -- 172.21.15.29:0/1392579770 >> 172.21.15.29:0/1392579770 conn(0x7f54d80fc7d0 msgr2=0x7f54d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 -- 172.21.15.29:0/1392579770 shutdown_connections 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.308+0000 7f54dd227640 1 -- 172.21.15.29:0/1392579770 wait complete. 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.309+0000 7f54dd227640 1 Processor -- start 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.309+0000 7f54dd227640 1 -- start start 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d8102dd0 0x7f54d81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8103780 0x7f54d8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 0x7f54d819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8111f80 con 0x7f54d8108300 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8111e00 con 0x7f54d8103780 2024-09-19T07:06:32.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8112100 con 0x7f54d8102dd0 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 0x7f54d819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 0x7f54d819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45838/0 (socket says 172.21.15.29:45838) 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 -- 172.21.15.29:0/2083630551 learned_addr learned my addr 172.21.15.29:0/2083630551 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d659c640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8103780 0x7f54d8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d6d9d640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d8102dd0 0x7f54d81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 -- 172.21.15.29:0/2083630551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d8102dd0 msgr2=0x7f54d81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d8102dd0 0x7f54d81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 -- 172.21.15.29:0/2083630551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8103780 msgr2=0x7f54d8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8103780 0x7f54d8198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 -- 172.21.15.29:0/2083630551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d819d490 con 0x7f54d8108300 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d659c640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8103780 0x7f54d8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54d759e640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 0x7f54d819cdb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f54c800b970 tx=0x7f54c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:32.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8019070 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f54c8014440 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c80075d0 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.310+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d819d780 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.311+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d81a5060 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.312+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d81031b0 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.313+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f54c801c070 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.314+0000 7f54cffff640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f54c40a3240 0x7f54c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.314+0000 7f54d6d9d640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f54c40a3240 0x7f54c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.314+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7f54c80cf660 con 0x7f54d8108300 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.314+0000 7f54d6d9d640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f54c40a3240 0x7f54c40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54d0005e10 tx=0x7f54d0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:32.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.317+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f54c809c160 con 0x7f54d8108300 2024-09-19T07:06:32.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.494+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f54d810a2e0 con 0x7f54d8108300 2024-09-19T07:06:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.821+0000 7f54cffff640 1 -- 172.21.15.29:0/2083630551 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v87) ==== 169+0+0 (secure 0 0 0) 0x7f54c809ba60 con 0x7f54d8108300 2024-09-19T07:06:32.822 INFO:teuthology.orchestra.run.smithi029.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T07:06:32.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f54c40a3240 msgr2=0x7f54c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:32.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f54c40a3240 0x7f54c40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f54d0005e10 tx=0x7f54d0005da0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 msgr2=0x7f54d819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 0x7f54d819cdb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f54c800b970 tx=0x7f54c800be30 comp rx=0 tx=0).stop 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 shutdown_connections 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54d8108300 0x7f54d819cdb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54d8103780 0x7f54d8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f54c40a3240 0x7f54c40a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 --2- 172.21.15.29:0/2083630551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54d8102dd0 0x7f54d81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.824+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 >> 172.21.15.29:0/2083630551 conn(0x7f54d80fc7d0 msgr2=0x7f54d8105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.825+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 shutdown_connections 2024-09-19T07:06:32.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:32.825+0000 7f54dd227640 1 -- 172.21.15.29:0/2083630551 wait complete. 2024-09-19T07:06:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:32 smithi029 ceph-mon[31255]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:06:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:32 smithi029 ceph-mon[31255]: pgmap v295: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-19T07:06:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:32 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2083630551' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T07:06:33.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:32 smithi078 ceph-mon[34556]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:06:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:32 smithi078 ceph-mon[34556]: pgmap v295: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-19T07:06:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:32 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2083630551' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T07:06:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:32 smithi046 ceph-mon[34147]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:06:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:32 smithi046 ceph-mon[34147]: pgmap v295: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-19T07:06:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:32 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2083630551' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T07:06:33.716 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T07:06:33.980 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:34.102 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:33 smithi029 ceph-mon[31255]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:06:34.102 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:33 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2083630551' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T07:06:34.102 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:33 smithi029 ceph-mon[31255]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:06:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:33 smithi078 ceph-mon[34556]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:06:34.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:33 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2083630551' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T07:06:34.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:33 smithi078 ceph-mon[34556]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:06:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:33 smithi046 ceph-mon[34147]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:06:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:33 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2083630551' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T07:06:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:33 smithi046 ceph-mon[34147]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 -- 172.21.15.29:0/2651880047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8103660 msgr2=0x7f6cf810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/2651880047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8103660 0x7f6cf810bb50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009900 tx=0x7f6ce802a480 comp rx=0 tx=0).stop 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 -- 172.21.15.29:0/2651880047 shutdown_connections 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/2651880047 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 0x7f6cf810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/2651880047 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8103660 0x7f6cf810bb50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/2651880047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8102d40 0x7f6cf8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 -- 172.21.15.29:0/2651880047 >> 172.21.15.29:0/2651880047 conn(0x7f6cf80fc7a0 msgr2=0x7f6cf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 -- 172.21.15.29:0/2651880047 shutdown_connections 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.460+0000 7f6cffcd1640 1 -- 172.21.15.29:0/2651880047 wait complete. 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.461+0000 7f6cffcd1640 1 Processor -- start 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.461+0000 7f6cffcd1640 1 -- start start 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.461+0000 7f6cffcd1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 0x7f6cf81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.461+0000 7f6cffcd1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8103660 0x7f6cf81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cffcd1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 0x7f6cf819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cffcd1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8111e20 con 0x7f6cf8102d40 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cffcd1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8111ca0 con 0x7f6cf810c170 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cffcd1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf8111fa0 con 0x7f6cf8103660 2024-09-19T07:06:34.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 0x7f6cf81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 0x7f6cf81983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45862/0 (socket says 172.21.15.29:45862) 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 -- 172.21.15.29:0/3870587871 learned_addr learned my addr 172.21.15.29:0/3870587871 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfd26c640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8103660 0x7f6cf81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfe26e640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 0x7f6cf819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 -- 172.21.15.29:0/3870587871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8103660 msgr2=0x7f6cf81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8103660 0x7f6cf81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 -- 172.21.15.29:0/3870587871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 msgr2=0x7f6cf819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 0x7f6cf819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 -- 172.21.15.29:0/3870587871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf819d350 con 0x7f6cf8102d40 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfd26c640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8103660 0x7f6cf81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:34.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfe26e640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 0x7f6cf819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cfda6d640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 0x7f6cf81983a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400d770 tx=0x7f6cf400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4017070 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6cf40054d0 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf819d640 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4004cf0 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.462+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf81a4f20 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.463+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8103120 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.464+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6cf4004e90 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.465+0000 7f6ceeffd640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6ce40a32c0 0x7f6ce40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.465+0000 7f6cfd26c640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6ce40a32c0 0x7f6ce40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.465+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7f6cf40cf5d0 con 0x7f6cf8102d40 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.466+0000 7f6cfd26c640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6ce40a32c0 0x7f6ce40a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8000c00 tx=0x7f6ce8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:34.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.469+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6cf409c0d0 con 0x7f6cf8102d40 2024-09-19T07:06:34.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.682+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6cf802d7c0 con 0x7f6cf8102d40 2024-09-19T07:06:34.825 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:34 smithi078 ceph-mon[34556]: pgmap v297: 129 pgs: 7 creating+peering, 15 unknown, 107 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T07:06:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.831+0000 7f6ceeffd640 1 -- 172.21.15.29:0/3870587871 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7f6cf409b9d0 con 0x7f6cf8102d40 2024-09-19T07:06:34.831 INFO:teuthology.orchestra.run.smithi029.stderr:added data pool 4 to fsmap 2024-09-19T07:06:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6ce40a32c0 msgr2=0x7f6ce40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6ce40a32c0 0x7f6ce40a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8000c00 tx=0x7f6ce8031400 comp rx=0 tx=0).stop 2024-09-19T07:06:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 msgr2=0x7f6cf81983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 0x7f6cf81983a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400d770 tx=0x7f6cf400dc30 comp rx=0 tx=0).stop 2024-09-19T07:06:34.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 shutdown_connections 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf810c170 0x7f6cf819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6ce40a32c0 0x7f6ce40a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cf8103660 0x7f6cf81988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 --2- 172.21.15.29:0/3870587871 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cf8102d40 0x7f6cf81983a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 >> 172.21.15.29:0/3870587871 conn(0x7f6cf80fc7a0 msgr2=0x7f6cf80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 shutdown_connections 2024-09-19T07:06:34.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:34.833+0000 7f6cffcd1640 1 -- 172.21.15.29:0/3870587871 wait complete. 2024-09-19T07:06:34.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:34 smithi046 ceph-mon[34147]: pgmap v297: 129 pgs: 7 creating+peering, 15 unknown, 107 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T07:06:34.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:34 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3870587871' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T07:06:35.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:34 smithi029 ceph-mon[31255]: pgmap v297: 129 pgs: 7 creating+peering, 15 unknown, 107 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T07:06:35.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:34 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3870587871' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T07:06:35.138 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:34 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3870587871' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T07:06:35.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:35.932 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:36.053 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:35 smithi029 ceph-mon[31255]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:06:36.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:35 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3870587871' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T07:06:36.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:35 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:06:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:35 smithi078 ceph-mon[34556]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:06:36.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:35 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3870587871' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T07:06:36.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:35 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:06:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:35 smithi046 ceph-mon[34147]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:06:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:35 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3870587871' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T07:06:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:35 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:06:36.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 -- 172.21.15.29:0/3113642507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc101df0 msgr2=0x7f23bc1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:36.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 --2- 172.21.15.29:0/3113642507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc101df0 0x7f23bc1021d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009900 tx=0x7f23ac02a410 comp rx=0 tx=0).stop 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 -- 172.21.15.29:0/3113642507 shutdown_connections 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 --2- 172.21.15.29:0/3113642507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc106f20 0x7f23bc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 --2- 172.21.15.29:0/3113642507 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc1027a0 0x7f23bc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 --2- 172.21.15.29:0/3113642507 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc101df0 0x7f23bc1021d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 -- 172.21.15.29:0/3113642507 >> 172.21.15.29:0/3113642507 conn(0x7f23bc0fd8f0 msgr2=0x7f23bc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 -- 172.21.15.29:0/3113642507 shutdown_connections 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.413+0000 7f23c1458640 1 -- 172.21.15.29:0/3113642507 wait complete. 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 Processor -- start 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 -- start start 2024-09-19T07:06:36.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc101df0 0x7f23bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc1027a0 0x7f23bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 0x7f23bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc111ed0 con 0x7f23bc106f20 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc111d50 con 0x7f23bc1027a0 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23c1458640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc112050 con 0x7f23bc101df0 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 0x7f23bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 0x7f23bc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41322/0 (socket says 172.21.15.29:41322) 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 -- 172.21.15.29:0/3033640082 learned_addr learned my addr 172.21.15.29:0/3033640082 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23baffd640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc101df0 0x7f23bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23ba7fc640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc1027a0 0x7f23bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:36.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 -- 172.21.15.29:0/3033640082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc101df0 msgr2=0x7f23bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc101df0 0x7f23bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 -- 172.21.15.29:0/3033640082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc1027a0 msgr2=0x7f23bc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc1027a0 0x7f23bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.414+0000 7f23bb7fe640 1 -- 172.21.15.29:0/3033640082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc1a6930 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.415+0000 7f23bb7fe640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 0x7f23bc074f70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009fd0 tx=0x7f23b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.415+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4011830 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.415+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23b4016070 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.415+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc1a6c20 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.415+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4010de0 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.415+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc1a7160 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.416+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc102250 con 0x7f23bc106f20 2024-09-19T07:06:36.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.417+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f23b40119d0 con 0x7f23bc106f20 2024-09-19T07:06:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.418+0000 7f23a3fff640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f23a40a32c0 0x7f23a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.418+0000 7f23baffd640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f23a40a32c0 0x7f23a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.418+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f23b40cf240 con 0x7f23bc106f20 2024-09-19T07:06:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.418+0000 7f23baffd640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f23a40a32c0 0x7f23a40a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f23ac031440 tx=0x7f23ac005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:36.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.422+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23b409bcc0 con 0x7f23bc106f20 2024-09-19T07:06:36.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.636+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23bc10a130 con 0x7f23bc106f20 2024-09-19T07:06:36.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.637+0000 7f23a3fff640 1 -- 172.21.15.29:0/3033640082 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11827 (secure 0 0 0) 0x7f23b409b5c0 con 0x7f23bc106f20 2024-09-19T07:06:36.638 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:36.638 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"btime":"2024-09-19T07:06:34:819162+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:06:34.683407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:06:36.638 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 16 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f23a40a32c0 msgr2=0x7f23a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f23a40a32c0 0x7f23a40a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f23ac031440 tx=0x7f23ac005e80 comp rx=0 tx=0).stop 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 msgr2=0x7f23bc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 0x7f23bc074f70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009fd0 tx=0x7f23b400b8e0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 shutdown_connections 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f23bc106f20 0x7f23bc074f70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23bc1027a0 0x7f23bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f23a40a32c0 0x7f23a40a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 --2- 172.21.15.29:0/3033640082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23bc101df0 0x7f23bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 >> 172.21.15.29:0/3033640082 conn(0x7f23bc0fd8f0 msgr2=0x7f23bc0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 shutdown_connections 2024-09-19T07:06:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:36.639+0000 7f23c1458640 1 -- 172.21.15.29:0/3033640082 wait complete. 2024-09-19T07:06:37.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:36 smithi029 ceph-mon[31255]: pgmap v299: 129 pgs: 7 creating+peering, 122 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T07:06:37.006 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:36 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3033640082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:37.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:36 smithi078 ceph-mon[34556]: pgmap v299: 129 pgs: 7 creating+peering, 122 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T07:06:37.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:36 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3033640082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:37.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:36 smithi046 ceph-mon[34147]: pgmap v299: 129 pgs: 7 creating+peering, 122 active+clean; 579 KiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T07:06:37.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:36 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3033640082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:37.402 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:06:37.661 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:38.062 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:37 smithi029 ceph-mon[31255]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T07:06:38.062 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:37 smithi029 ceph-mon[31255]: Cluster is now healthy 2024-09-19T07:06:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 -- 172.21.15.29:0/3031728758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8101de0 msgr2=0x7fe2c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3031728758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8101de0 0x7fe2c81021c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009900 tx=0x7fe2c402a410 comp rx=0 tx=0).stop 2024-09-19T07:06:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 -- 172.21.15.29:0/3031728758 shutdown_connections 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3031728758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2c8106f10 0x7fe2c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3031728758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8102790 0x7fe2c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3031728758 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8101de0 0x7fe2c81021c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 -- 172.21.15.29:0/3031728758 >> 172.21.15.29:0/3031728758 conn(0x7fe2c80fd8c0 msgr2=0x7fe2c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 -- 172.21.15.29:0/3031728758 shutdown_connections 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.142+0000 7fe2d0351640 1 -- 172.21.15.29:0/3031728758 wait complete. 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 Processor -- start 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 -- start start 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8101de0 0x7fe2c81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2c8102790 0x7fe2c8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 0x7fe2c819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8111e20 con 0x7fe2c8106f10 2024-09-19T07:06:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8111ca0 con 0x7fe2c8102790 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2d0351640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8111fa0 con 0x7fe2c8101de0 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 0x7fe2c819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 0x7fe2c819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41348/0 (socket says 172.21.15.29:41348) 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 -- 172.21.15.29:0/3666400260 learned_addr learned my addr 172.21.15.29:0/3666400260 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce0ed640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8101de0 0x7fe2c81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2cd8ec640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2c8102790 0x7fe2c8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 -- 172.21.15.29:0/3666400260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8101de0 msgr2=0x7fe2c81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8101de0 0x7fe2c81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 -- 172.21.15.29:0/3666400260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2c8102790 msgr2=0x7fe2c8198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.143+0000 7fe2ce8ee640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2c8102790 0x7fe2c8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2ce8ee640 1 -- 172.21.15.29:0/3666400260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c819d290 con 0x7fe2c8106f10 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2ce0ed640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8101de0 0x7fe2c81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2ce8ee640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 0x7fe2c819cbb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000cce0 tx=0x7fe2c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000f450 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe2c000faa0 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c819d580 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0018b70 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.144+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c81a4e60 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.145+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c81021c0 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.146+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe2c0018d10 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.147+0000 7fe2bf7fe640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe2b40a32c0 0x7fe2b40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.147+0000 7fe2ce0ed640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe2b40a32c0 0x7fe2b40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.147+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fe2c00d0080 con 0x7fe2c8106f10 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.147+0000 7fe2ce0ed640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe2b40a32c0 0x7fe2b40a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4031440 tx=0x7fe2c4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:38.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.150+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2c0014030 con 0x7fe2c8106f10 2024-09-19T07:06:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:37 smithi078 ceph-mon[34556]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T07:06:38.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:37 smithi078 ceph-mon[34556]: Cluster is now healthy 2024-09-19T07:06:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:37 smithi046 ceph-mon[34147]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T07:06:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:37 smithi046 ceph-mon[34147]: Cluster is now healthy 2024-09-19T07:06:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.327+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2c8199640 con 0x7fe2c8106f10 2024-09-19T07:06:38.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.328+0000 7fe2bf7fe640 1 -- 172.21.15.29:0/3666400260 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24128 (secure 0 0 0) 0x7fe2c8199640 con 0x7fe2c8106f10 2024-09-19T07:06:38.329 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:38.330 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":88,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:06:34.683258+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:06:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.330+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe2b40a32c0 msgr2=0x7fe2b40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.330+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe2b40a32c0 0x7fe2b40a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4031440 tx=0x7fe2c4005a20 comp rx=0 tx=0).stop 2024-09-19T07:06:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.330+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 msgr2=0x7fe2c819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.330+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 0x7fe2c819cbb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000cce0 tx=0x7fe2c000a620 comp rx=0 tx=0).stop 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 shutdown_connections 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2c8106f10 0x7fe2c819cbb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2c8102790 0x7fe2c8198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe2b40a32c0 0x7fe2b40a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 --2- 172.21.15.29:0/3666400260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2c8101de0 0x7fe2c81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 >> 172.21.15.29:0/3666400260 conn(0x7fe2c80fd8c0 msgr2=0x7fe2c80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 shutdown_connections 2024-09-19T07:06:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:38.331+0000 7fe2d0351640 1 -- 172.21.15.29:0/3666400260 wait complete. 2024-09-19T07:06:39.079 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:38 smithi029 ceph-mon[31255]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:39.079 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3666400260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:39.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:06:39.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:38 smithi078 ceph-mon[34556]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:39.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3666400260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:39.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:38 smithi046 ceph-mon[34147]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:39.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3666400260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:39.373 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:39.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 -- 172.21.15.29:0/3537849569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0100e20 msgr2=0x7f94b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:39.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 --2- 172.21.15.29:0/3537849569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0100e20 0x7f94b0101200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009900 tx=0x7f94a002a480 comp rx=0 tx=0).stop 2024-09-19T07:06:39.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 -- 172.21.15.29:0/3537849569 shutdown_connections 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 --2- 172.21.15.29:0/3537849569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0102ef0 0x7f94b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 --2- 172.21.15.29:0/3537849569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 0x7f94b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 --2- 172.21.15.29:0/3537849569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0100e20 0x7f94b0101200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 -- 172.21.15.29:0/3537849569 >> 172.21.15.29:0/3537849569 conn(0x7f94b00fc7d0 msgr2=0x7f94b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 -- 172.21.15.29:0/3537849569 shutdown_connections 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 -- 172.21.15.29:0/3537849569 wait complete. 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 Processor -- start 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.846+0000 7f94b6760640 1 -- start start 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100e20 0x7f94b01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 0x7f94b01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 0x7f94b019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:39.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0110e30 con 0x7f94b0102ef0 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0110cb0 con 0x7f94b0102570 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0110fb0 con 0x7f94b0100e20 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 0x7f94b019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 0x7f94b019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41368/0 (socket says 172.21.15.29:41368) 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 -- 172.21.15.29:0/4140718923 learned_addr learned my addr 172.21.15.29:0/4140718923 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94affff640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100e20 0x7f94b01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94a7fff640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 0x7f94b01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 -- 172.21.15.29:0/4140718923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100e20 msgr2=0x7f94b01983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100e20 0x7f94b01983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 -- 172.21.15.29:0/4140718923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 msgr2=0x7f94b01988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 0x7f94b01988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:39.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 -- 172.21.15.29:0/4140718923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b019d360 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94a7fff640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 0x7f94b01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b4cfd640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 0x7f94b019cc80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f94a800cce0 tx=0x7f94a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a800f450 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f94a800faa0 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b019d650 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8018b70 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.847+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b01a4f30 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.849+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b0101200 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.850+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f94a8018d10 con 0x7f94b0102ef0 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.851+0000 7f94adffb640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f949c0a3240 0x7f949c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:39.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.851+0000 7f94affff640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f949c0a3240 0x7f949c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:39.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.851+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f94a80cffe0 con 0x7f94b0102ef0 2024-09-19T07:06:39.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.851+0000 7f94affff640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f949c0a3240 0x7f949c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009230 tx=0x7f94a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:39.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:39.854+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94a8014030 con 0x7f94b0102ef0 2024-09-19T07:06:40.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.034+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94b0199710 con 0x7f94b0102ef0 2024-09-19T07:06:40.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.035+0000 7f94adffb640 1 -- 172.21.15.29:0/4140718923 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24128 (secure 0 0 0) 0x7f94a809cb50 con 0x7f94b0102ef0 2024-09-19T07:06:40.036 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:40.037 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":88,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:06:34.683258+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f949c0a3240 msgr2=0x7f949c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f949c0a3240 0x7f949c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009230 tx=0x7f94a00058d0 comp rx=0 tx=0).stop 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 msgr2=0x7f94b019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 0x7f94b019cc80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f94a800cce0 tx=0x7f94a800a620 comp rx=0 tx=0).stop 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 shutdown_connections 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f94b0102ef0 0x7f94b019cc80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94b0102570 0x7f94b01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f949c0a3240 0x7f949c0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 --2- 172.21.15.29:0/4140718923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94b0100e20 0x7f94b01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 >> 172.21.15.29:0/4140718923 conn(0x7f94b00fc7d0 msgr2=0x7f94b0105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 shutdown_connections 2024-09-19T07:06:40.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:40.038+0000 7f94b6760640 1 -- 172.21.15.29:0/4140718923 wait complete. 2024-09-19T07:06:40.766 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:06:41.030 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:40 smithi029 ceph-mon[31255]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:40 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4140718923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:41.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:40 smithi078 ceph-mon[34556]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:41.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:40 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4140718923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:40 smithi046 ceph-mon[34147]: pgmap v301: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:41.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:40 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4140718923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:41.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.537+0000 7f474be9d640 1 -- 172.21.15.29:0/4268614583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744101de0 msgr2=0x7f47441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.537+0000 7f474be9d640 1 --2- 172.21.15.29:0/4268614583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744101de0 0x7f47441021c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f473c009900 tx=0x7f473c02a410 comp rx=0 tx=0).stop 2024-09-19T07:06:41.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.537+0000 7f474be9d640 1 -- 172.21.15.29:0/4268614583 shutdown_connections 2024-09-19T07:06:41.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.537+0000 7f474be9d640 1 --2- 172.21.15.29:0/4268614583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744106f10 0x7f474410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.537+0000 7f474be9d640 1 --2- 172.21.15.29:0/4268614583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4744102790 0x7f47441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.537+0000 7f474be9d640 1 --2- 172.21.15.29:0/4268614583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744101de0 0x7f47441021c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- 172.21.15.29:0/4268614583 >> 172.21.15.29:0/4268614583 conn(0x7f47440fd8c0 msgr2=0x7f47440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- 172.21.15.29:0/4268614583 shutdown_connections 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- 172.21.15.29:0/4268614583 wait complete. 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 Processor -- start 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- start start 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4744101de0 0x7f47441983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 0x7f4744198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744106f10 0x7f474419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4744111e60 con 0x7f4744102790 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4744111ce0 con 0x7f4744106f10 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.538+0000 7f474be9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4744111fe0 con 0x7f4744101de0 2024-09-19T07:06:41.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 0x7f4744198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 0x7f4744198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41392/0 (socket says 172.21.15.29:41392) 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 -- 172.21.15.29:0/3727296957 learned_addr learned my addr 172.21.15.29:0/3727296957 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749c39640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4744101de0 0x7f47441983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f474a43a640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744106f10 0x7f474419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 -- 172.21.15.29:0/3727296957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4744101de0 msgr2=0x7f47441983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4744101de0 0x7f47441983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 -- 172.21.15.29:0/3727296957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744106f10 msgr2=0x7f474419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744106f10 0x7f474419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 -- 172.21.15.29:0/3727296957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474419d390 con 0x7f4744102790 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4749438640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 0x7f4744198920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f473800c970 tx=0x7f473800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738007bb0 con 0x7f4744102790 2024-09-19T07:06:41.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4738007d50 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474419d680 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473800f450 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.539+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47441a4f60 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.540+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47441021c0 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.542+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4738004f00 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.542+0000 7f4742ffd640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f472c0a32c0 0x7f472c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.542+0000 7f4749c39640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f472c0a32c0 0x7f472c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.542+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f47380cfba0 con 0x7f4744102790 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.543+0000 7f4749c39640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f472c0a32c0 0x7f472c0a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f473c031440 tx=0x7f473c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:41.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.545+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4738014030 con 0x7f4744102790 2024-09-19T07:06:41.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.758+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4744199740 con 0x7f4744102790 2024-09-19T07:06:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.759+0000 7f4742ffd640 1 -- 172.21.15.29:0/3727296957 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11827 (secure 0 0 0) 0x7f4744199740 con 0x7f4744102790 2024-09-19T07:06:41.760 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:41.760 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":16,"btime":"2024-09-19T07:06:34:819162+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24488,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:06:34.683407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:06:41.760 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 16 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f472c0a32c0 msgr2=0x7f472c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f472c0a32c0 0x7f472c0a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f473c031440 tx=0x7f473c005e80 comp rx=0 tx=0).stop 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 msgr2=0x7f4744198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 0x7f4744198920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f473800c970 tx=0x7f473800ce30 comp rx=0 tx=0).stop 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 shutdown_connections 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4744106f10 0x7f474419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4744102790 0x7f4744198920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f472c0a32c0 0x7f472c0a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 --2- 172.21.15.29:0/3727296957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4744101de0 0x7f47441983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 >> 172.21.15.29:0/3727296957 conn(0x7f47440fd8c0 msgr2=0x7f47440fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:41.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 shutdown_connections 2024-09-19T07:06:41.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:41.762+0000 7f474be9d640 1 -- 172.21.15.29:0/3727296957 wait complete. 2024-09-19T07:06:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:41 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3727296957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:42.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:41 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3727296957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:41 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3727296957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:06:42.608 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:06:42.865 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:43.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:42 smithi078 ceph-mon[34556]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:43.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:42 smithi046 ceph-mon[34147]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:43.246 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:42 smithi029 ceph-mon[31255]: pgmap v302: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 -- 172.21.15.29:0/2523333146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102570 msgr2=0x7f4a701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 --2- 172.21.15.29:0/2523333146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102570 0x7f4a701029b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4a60009900 tx=0x7f4a6002a480 comp rx=0 tx=0).stop 2024-09-19T07:06:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 -- 172.21.15.29:0/2523333146 shutdown_connections 2024-09-19T07:06:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 --2- 172.21.15.29:0/2523333146 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a70102ef0 0x7f4a7010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 --2- 172.21.15.29:0/2523333146 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102570 0x7f4a701029b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 --2- 172.21.15.29:0/2523333146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70100e20 0x7f4a70101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 -- 172.21.15.29:0/2523333146 >> 172.21.15.29:0/2523333146 conn(0x7f4a700fc7d0 msgr2=0x7f4a700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 -- 172.21.15.29:0/2523333146 shutdown_connections 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 -- 172.21.15.29:0/2523333146 wait complete. 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.328+0000 7f4a77c01640 1 Processor -- start 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 -- start start 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a70100e20 0x7f4a70199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70102570 0x7f4a70199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 0x7f4a701a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4a70110e30 con 0x7f4a70102ef0 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a70110cb0 con 0x7f4a70102570 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a77c01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4a70110fb0 con 0x7f4a70100e20 2024-09-19T07:06:43.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 0x7f4a701a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 0x7f4a701a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41420/0 (socket says 172.21.15.29:41420) 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 -- 172.21.15.29:0/3016222926 learned_addr learned my addr 172.21.15.29:0/3016222926 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7519c640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70102570 0x7f4a70199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7599d640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a70100e20 0x7f4a70199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 -- 172.21.15.29:0/3016222926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a70100e20 msgr2=0x7f4a70199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a70100e20 0x7f4a70199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 -- 172.21.15.29:0/3016222926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70102570 msgr2=0x7f4a70199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70102570 0x7f4a70199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 -- 172.21.15.29:0/3016222926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a701a47c0 con 0x7f4a70102ef0 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7519c640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70102570 0x7f4a70199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.329+0000 7f4a7619e640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 0x7f4a701a4280 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800cce0 tx=0x7f4a6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:43.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.330+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800f450 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.330+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a6800faa0 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.330+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68018b70 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.330+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a701a4990 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.330+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a701a4ea0 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.331+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a70101200 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.332+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4a68018d10 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.333+0000 7f4a66ffd640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4a5c0a32c0 0x7f4a5c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.333+0000 7f4a7599d640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4a5c0a32c0 0x7f4a5c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.333+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f4a680cfea0 con 0x7f4a70102ef0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.333+0000 7f4a7599d640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4a5c0a32c0 0x7f4a5c0a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0058c0 tx=0x7f4a6c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.337+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a68014030 con 0x7f4a70102ef0 2024-09-19T07:06:43.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.516+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a70109090 con 0x7f4a70102ef0 2024-09-19T07:06:43.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.518+0000 7f4a66ffd640 1 -- 172.21.15.29:0/3016222926 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24128 (secure 0 0 0) 0x7f4a6809c980 con 0x7f4a70102ef0 2024-09-19T07:06:43.519 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:43.519 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":88,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:06:34.683258+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:06:43.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4a5c0a32c0 msgr2=0x7f4a5c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4a5c0a32c0 0x7f4a5c0a5780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0058c0 tx=0x7f4a6c00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 msgr2=0x7f4a701a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 0x7f4a701a4280 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800cce0 tx=0x7f4a6800a620 comp rx=0 tx=0).stop 2024-09-19T07:06:43.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 shutdown_connections 2024-09-19T07:06:43.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a70102ef0 0x7f4a701a4280 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a70102570 0x7f4a70199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4a5c0a32c0 0x7f4a5c0a5780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 --2- 172.21.15.29:0/3016222926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a70100e20 0x7f4a70199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 >> 172.21.15.29:0/3016222926 conn(0x7f4a700fc7d0 msgr2=0x7f4a700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.520+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 shutdown_connections 2024-09-19T07:06:43.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:43.521+0000 7f4a77c01640 1 -- 172.21.15.29:0/3016222926 wait complete. 2024-09-19T07:06:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:43 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3016222926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:44.208 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:43 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3016222926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:43 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3016222926' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:44.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T07:06:25.493071+0000', 'modified': '2024-09-19T07:06:34.683407+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.78:6839/2907917016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6838', 'nonce': 2907917016}, {'type': 'v1', 'addr': '172.21.15.78:6839', 'nonce': 2907917016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24499, 'qdb_cluster': [24499]} 2024-09-19T07:06:44.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T07:06:44.240 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:06:44.498 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:45.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.983+0000 7f702fdec640 1 -- 172.21.15.29:0/209685710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 msgr2=0x7f702810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.983+0000 7f702fdec640 1 --2- 172.21.15.29:0/209685710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f702810bb30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7018009900 tx=0x7f701802a480 comp rx=0 tx=0).stop 2024-09-19T07:06:45.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- 172.21.15.29:0/209685710 shutdown_connections 2024-09-19T07:06:45.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 --2- 172.21.15.29:0/209685710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702810c150 0x7f702810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 --2- 172.21.15.29:0/209685710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f702810bb30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 --2- 172.21.15.29:0/209685710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7028102d20 0x7f7028103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- 172.21.15.29:0/209685710 >> 172.21.15.29:0/209685710 conn(0x7f70280fc780 msgr2=0x7f70280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- 172.21.15.29:0/209685710 shutdown_connections 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- 172.21.15.29:0/209685710 wait complete. 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 Processor -- start 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- start start 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7028102d20 0x7f7028198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f70281989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702810c150 0x7f702819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7028111e40 con 0x7f7028103640 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.984+0000 7f702fdec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7028111cc0 con 0x7f702810c150 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702fdec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7028111fc0 con 0x7f7028102d20 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f70281989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f70281989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41434/0 (socket says 172.21.15.29:41434) 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 -- 172.21.15.29:0/3572975574 learned_addr learned my addr 172.21.15.29:0/3572975574 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702e389640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702810c150 0x7f702819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702db88640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7028102d20 0x7f7028198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 -- 172.21.15.29:0/3572975574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7028102d20 msgr2=0x7f7028198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7028102d20 0x7f7028198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 -- 172.21.15.29:0/3572975574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702810c150 msgr2=0x7f702819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702810c150 0x7f702819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 -- 172.21.15.29:0/3572975574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702819d430 con 0x7f7028103640 2024-09-19T07:06:45.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702d387640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f70281989c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7018005940 tx=0x7f70180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f701effd640 1 -- 172.21.15.29:0/3572975574 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701803f030 con 0x7f7028103640 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f701effd640 1 -- 172.21.15.29:0/3572975574 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7018003cb0 con 0x7f7028103640 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f701effd640 1 -- 172.21.15.29:0/3572975574 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018035070 con 0x7f7028103640 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702819d6c0 con 0x7f7028103640 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.985+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70281a5000 con 0x7f7028103640 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.988+0000 7f701effd640 1 -- 172.21.15.29:0/3572975574 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7018042030 con 0x7f7028103640 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.988+0000 7f70321c5740 1 Processor -- start 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.988+0000 7f70321c5740 1 -- start start 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.988+0000 7f70321c5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfc1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.988+0000 7f701effd640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70140a3240 0x7f70140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.988+0000 7f70321c5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc21b0 0x55d82bfd0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f70321c5740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfd33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f70321c5740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d82bf28090 con 0x55d82bfd0fc0 2024-09-19T07:06:45.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f70321c5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d82becfa70 con 0x55d82bfc1890 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f70321c5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d82bf24050 con 0x55d82bfc21b0 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfd33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702db88640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70140a3240 0x7f70140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfd33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41448/0 (socket says 172.21.15.29:41448) 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 -- 172.21.15.29:0/1473033831 learned_addr learned my addr 172.21.15.29:0/1473033831 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfc1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f701effd640 1 -- 172.21.15.29:0/3572975574 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f70180f0210 con 0x7f7028103640 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702d387640 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc21b0 0x55d82bfd0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 -- 172.21.15.29:0/1473033831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc21b0 msgr2=0x55d82bfd0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc21b0 0x55d82bfd0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 -- 172.21.15.29:0/1473033831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 msgr2=0x55d82bfc1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfc1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 -- 172.21.15.29:0/1473033831 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82bedc130 con 0x55d82bfd0fc0 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702e389640 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfd33b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7020012aa0 tx=0x7f7020009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c3e39da61a6333 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f702db88640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70140a3240 0x7f70140a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7024009990 tx=0x7f7024009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f7013fff640 1 -- 172.21.15.29:0/1473033831 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020003a30 con 0x55d82bfd0fc0 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f7013fff640 1 -- 172.21.15.29:0/1473033831 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7020010ce0 con 0x55d82bfd0fc0 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.989+0000 7f7013fff640 1 -- 172.21.15.29:0/1473033831 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020004490 con 0x55d82bfd0fc0 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 -- 172.21.15.29:0/1473033831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 msgr2=0x55d82bfd33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfd33b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7020012aa0 tx=0x7f7020009a70 comp rx=0 tx=0).stop 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 -- 172.21.15.29:0/1473033831 shutdown_connections 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfd33b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc21b0 0x55d82bfd0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 --2- 172.21.15.29:0/1473033831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfc1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 -- 172.21.15.29:0/1473033831 >> 172.21.15.29:0/1473033831 conn(0x55d82bfbdf60 msgr2=0x55d82bfbe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 -- 172.21.15.29:0/1473033831 shutdown_connections 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.990+0000 7f70321c5740 1 -- 172.21.15.29:0/1473033831 wait complete. 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 -- start start 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 Processor -- start 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc1890 0x55d82bfd0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfcdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfd3b90 con 0x55d82bfd0fc0 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d82bee2f20 con 0x55d82bfc21b0 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfd3d10 con 0x55d82bfc1890 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f70321c5740 10 client.0 _ll_register_callbacks cb 0x55d82beac030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:06:45.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41450/0 (socket says 172.21.15.29:41450) 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 -- 172.21.15.29:0/1977587421 learned_addr learned my addr 172.21.15.29:0/1977587421 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702db88640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc1890 0x55d82bfd0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702d387640 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfcdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 -- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc1890 msgr2=0x55d82bfd0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc1890 0x55d82bfd0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 -- 172.21.15.29:0/1977587421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 msgr2=0x55d82bfcdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.991+0000 7f702e389640 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfcdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f702e389640 1 -- 172.21.15.29:0/1977587421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82bc992b0 con 0x55d82bfd0fc0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f702e389640 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfce1e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7020010b10 tx=0x7f70200040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f071e36bc8552ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70117fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70117fa640 1 -- 172.21.15.29:0/1977587421 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020023020 con 0x55d82bfd0fc0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70117fa640 1 -- 172.21.15.29:0/1977587421 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f7020004a40 con 0x55d82bfd0fc0 2024-09-19T07:06:45.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7020010ce0 con 0x55d82bfd0fc0 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70117fa640 1 -- 172.21.15.29:0/1977587421 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f702002e050 con 0x55d82bfd0fc0 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70321c5740 10 client.14718 fetch_fsmap learned FSMap version 16 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55d82bfdf5a0 con 0x55d82bfd0fc0 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70117fa640 1 -- 172.21.15.29:0/1977587421 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7020010ce0 con 0x55d82bfd0fc0 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70117fa640 1 -- 172.21.15.29:0/1977587421 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f702000f040 con 0x55d82bfd0fc0 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.992+0000 7f70321c5740 10 client.14718 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f70321c5740 10 client.14718 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f70321c5740 20 client.14718 populate_metadata read hostname 'smithi029' 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f70321c5740 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82bfe1880 0x55d82bfe2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f70321c5740 4 client.14718 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 --> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d82bf35600 con 0x55d82bfe1880 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f702db88640 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82bfe1880 0x55d82bfe2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f702db88640 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82bfe1880 0x55d82bfe2cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=719deecea8dc6ffa server_cookie=6547c875025580f4 in_seq=0 out_seq=0 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.993+0000 7f70117fa640 10 client.14718 ms_handle_connect on v2:172.21.15.78:6838/2907917016 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70117fa640 1 -- 172.21.15.29:0/1977587421 <== mds.0 v2:172.21.15.78:6838/2907917016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d82bf35600 con 0x55d82bfe1880 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70117fa640 10 client.14718 handle_command_reply: tid=0 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 client.14718 shutdown 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 msgr2=0x55d82bfce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfce1e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7020010b10 tx=0x7f70200040f0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 shutdown_connections 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82bfe1880 0x55d82bfe2cf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfd0fc0 0x55d82bfce1e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfcdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70117fa640 0 client.14718 ms_handle_reset on v2:172.21.15.78:6838/2907917016 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 --2- 172.21.15.29:0/1977587421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfc1890 0x55d82bfd0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 >> 172.21.15.29:0/1977587421 conn(0x55d82bfbdf60 msgr2=0x55d82bfc3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 shutdown_connections 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.994+0000 7f70321c5740 1 -- 172.21.15.29:0/1977587421 wait complete. 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:44.995+0000 7f70321c5740 20 client.14718 trim_cache size 0 max 16384 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.012+0000 7f70321c5740 1 Processor -- start 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.012+0000 7f70321c5740 1 -- start start 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70321c5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfe0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70321c5740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 0x55d82bfc8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70321c5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfc8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70321c5740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfe1030 con 0x55d82bfc21b0 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70321c5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfe1700 con 0x55d82bfc1890 2024-09-19T07:06:45.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70321c5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfe1dd0 con 0x55d82bfd0fc0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 0x55d82bfc8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 0x55d82bfc8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41454/0 (socket says 172.21.15.29:41454) 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 -- 172.21.15.29:0/1889609280 learned_addr learned my addr 172.21.15.29:0/1889609280 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702db88640 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfe0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702e389640 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfc8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 -- 172.21.15.29:0/1889609280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 msgr2=0x55d82bfc8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfc8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 -- 172.21.15.29:0/1889609280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 msgr2=0x55d82bfe0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfe0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 -- 172.21.15.29:0/1889609280 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82bfbda00 con 0x55d82bfc21b0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f702d387640 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 0x55d82bfc8a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7018006010 tx=0x7f70180bc2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6313373178cdf6ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70137fe640 1 -- 172.21.15.29:0/1889609280 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018049040 con 0x55d82bfc21b0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.013+0000 7f70137fe640 1 -- 172.21.15.29:0/1889609280 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70180bcd90 con 0x55d82bfc21b0 2024-09-19T07:06:45.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70137fe640 1 -- 172.21.15.29:0/1889609280 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70180c5300 con 0x55d82bfc21b0 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 -- 172.21.15.29:0/1889609280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 msgr2=0x55d82bfc8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 0x55d82bfc8a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7018006010 tx=0x7f70180bc2d0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 -- 172.21.15.29:0/1889609280 shutdown_connections 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfc8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc21b0 0x55d82bfc8a20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 --2- 172.21.15.29:0/1889609280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc1890 0x55d82bfe0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 -- 172.21.15.29:0/1889609280 >> 172.21.15.29:0/1889609280 conn(0x55d82bfbdf60 msgr2=0x55d82bfb8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 -- 172.21.15.29:0/1889609280 shutdown_connections 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 -- 172.21.15.29:0/1889609280 wait complete. 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.014+0000 7f70321c5740 1 -- start start 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 Processor -- start 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 0x55d82bfe3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfe43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfe4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfe2b70 con 0x55d82bfc1890 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfe24a0 con 0x55d82bfc21b0 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d82bfe3240 con 0x55d82bfd0fc0 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70321c5740 10 client.0 _ll_register_callbacks cb 0x7f7020012590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 0x55d82bfe3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 0x55d82bfe3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:41470/0 (socket says 172.21.15.29:41470) 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 -- 172.21.15.29:0/603596536 learned_addr learned my addr 172.21.15.29:0/603596536 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702d387640 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfe43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 -- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 msgr2=0x55d82bfe4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfe4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 -- 172.21.15.29:0/603596536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 msgr2=0x55d82bfe43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfe43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 -- 172.21.15.29:0/603596536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82bfce550 con 0x55d82bfc1890 2024-09-19T07:06:45.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f702db88640 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 0x55d82bfe3ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55d82bfcd510 tx=0x7f70240047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2eb63bacc2d6e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.015+0000 7f70117fa640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70117fa640 1 -- 172.21.15.29:0/603596536 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702401b040 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70117fa640 1 -- 172.21.15.29:0/603596536 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f7024021420 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70180bcd90 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70117fa640 1 -- 172.21.15.29:0/603596536 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f7024021620 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 10 client.14724 fetch_fsmap learned FSMap version 16 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55d82c04b250 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70117fa640 1 -- 172.21.15.29:0/603596536 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70180bcd90 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70117fa640 1 -- 172.21.15.29:0/603596536 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7f702402e070 con 0x55d82bfc1890 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 10 client.14724 fetch_fsmap finished waiting for FSMap version 16 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 10 client.14724 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 20 client.14724 populate_metadata read hostname 'smithi029' 2024-09-19T07:06:45.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82c04ff20 0x55d82c04ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 4 client.14724 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.016+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 --> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] -- command(tid 0: {"prefix": "status"}) -- 0x55d82bf2fb10 con 0x55d82c04ff20 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f702d387640 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82c04ff20 0x55d82c04ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f702d387640 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82c04ff20 0x55d82c04ec30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65694fbb343f6d52 server_cookie=81dcb109f86559fe in_seq=0 out_seq=0 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70117fa640 10 client.14724 ms_handle_connect on v2:172.21.15.78:6838/2907917016 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70117fa640 1 -- 172.21.15.29:0/603596536 <== mds.0 v2:172.21.15.78:6838/2907917016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d82bf2fb10 con 0x55d82c04ff20 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70117fa640 10 client.14724 handle_command_reply: tid=0 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 client.14724 shutdown 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 msgr2=0x55d82bfe3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 0x55d82bfe3ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55d82bfcd510 tx=0x7f70240047d0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 shutdown_connections 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x55d82c04ff20 0x55d82c04ec30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d82bfd0fc0 0x55d82bfe4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70117fa640 0 client.14724 ms_handle_reset on v2:172.21.15.78:6838/2907917016 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d82bfc21b0 0x55d82bfe43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 --2- 172.21.15.29:0/603596536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d82bfc1890 0x55d82bfe3ea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.017+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 >> 172.21.15.29:0/603596536 conn(0x55d82bfbdf60 msgr2=0x55d82bfcc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 shutdown_connections 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f70321c5740 1 -- 172.21.15.29:0/603596536 wait complete. 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f70321c5740 20 client.14724 trim_cache size 0 max 16384 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "6a046fca-7654-11ef-bceb-c7b262605968", 2024-09-19T07:06:45.051 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24499, 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 19.217387208000002, 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 16, 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 88, 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 88, 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 39.660265754999998 2024-09-19T07:06:45.052 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70140a3240 msgr2=0x7f70140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70140a3240 0x7f70140a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7024009990 tx=0x7f7024009110 comp rx=0 tx=0).stop 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 msgr2=0x7f70281989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f70281989c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7018005940 tx=0x7f70180042f0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 shutdown_connections 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f702810c150 0x7f702819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7028103640 0x7f70281989c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70140a3240 0x7f70140a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 --2- 172.21.15.29:0/3572975574 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7028102d20 0x7f7028198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 >> 172.21.15.29:0/3572975574 conn(0x7f70280fc780 msgr2=0x7f70280fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 shutdown_connections 2024-09-19T07:06:45.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:45.018+0000 7f702fdec640 1 -- 172.21.15.29:0/3572975574 wait complete. 2024-09-19T07:06:45.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:44 smithi078 ceph-mon[34556]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:45.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:44 smithi046 ceph-mon[34147]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:45.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:44 smithi029 ceph-mon[31255]: pgmap v303: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:45.904 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T07:06:45.904 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:45.904 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T07:06:46.161 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 -- 172.21.15.29:0/3543381560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481082a0 msgr2=0x7f114810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 --2- 172.21.15.29:0/3543381560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481082a0 0x7f114810ec40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1140009930 tx=0x7f114002a420 comp rx=0 tx=0).stop 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 -- 172.21.15.29:0/3543381560 shutdown_connections 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 --2- 172.21.15.29:0/3543381560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481082a0 0x7f114810ec40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 --2- 172.21.15.29:0/3543381560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11481036e0 0x7f1148107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 --2- 172.21.15.29:0/3543381560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1148102d30 0x7f1148103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 -- 172.21.15.29:0/3543381560 >> 172.21.15.29:0/3543381560 conn(0x7f11480fc7d0 msgr2=0x7f11480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 -- 172.21.15.29:0/3543381560 shutdown_connections 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 -- 172.21.15.29:0/3543381560 wait complete. 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.773+0000 7f114d740640 1 Processor -- start 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 -- start start 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1148102d30 0x7f1148100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 0x7f1148100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11481082a0 0x7f1148101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1148111f50 con 0x7f11481036e0 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1148111dd0 con 0x7f1148102d30 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f114d740640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f11481120d0 con 0x7f11481082a0 2024-09-19T07:06:46.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 0x7f1148100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 0x7f1148100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35086/0 (socket says 172.21.15.29:35086) 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 -- 172.21.15.29:0/2226776254 learned_addr learned my addr 172.21.15.29:0/2226776254 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11477fe640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11481082a0 0x7f1148101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f1146ffd640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1148102d30 0x7f1148100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 -- 172.21.15.29:0/2226776254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11481082a0 msgr2=0x7f1148101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11481082a0 0x7f1148101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 -- 172.21.15.29:0/2226776254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1148102d30 msgr2=0x7f1148100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1148102d30 0x7f1148100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 -- 172.21.15.29:0/2226776254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11481a6930 con 0x7f11481036e0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.774+0000 7f11467fc640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 0x7f1148100ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f113c00e9f0 tx=0x7f113c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.775+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c00ccc0 con 0x7f11481036e0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.775+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f113c0108e0 con 0x7f11481036e0 2024-09-19T07:06:46.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.775+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481a6c20 con 0x7f11481036e0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.775+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113c0187e0 con 0x7f11481036e0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.775+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a71b0 con 0x7f11481036e0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.776+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1148103110 con 0x7f11481036e0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.777+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f113c010a90 con 0x7f11481036e0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.777+0000 7f112ffff640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f11300a32c0 0x7f11300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.778+0000 7f1146ffd640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f11300a32c0 0x7f11300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.778+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f113c0cfe30 con 0x7f11481036e0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.778+0000 7f1146ffd640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f11300a32c0 0x7f11300a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1138005fd0 tx=0x7f1138009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:46.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.782+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f113c09c910 con 0x7f11481036e0 2024-09-19T07:06:46.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.995+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f114810a2b0 con 0x7f11481036e0 2024-09-19T07:06:46.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:46 smithi029 ceph-mon[31255]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:46.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.995+0000 7f112ffff640 1 -- 172.21.15.29:0/2226776254 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7f113c09c210 con 0x7f11481036e0 2024-09-19T07:06:46.997 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T07:06:46.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.997+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f11300a32c0 msgr2=0x7f11300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:46.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.997+0000 7f114d740640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f11300a32c0 0x7f11300a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1138005fd0 tx=0x7f1138009870 comp rx=0 tx=0).stop 2024-09-19T07:06:46.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.997+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 msgr2=0x7f1148100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:46.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.997+0000 7f114d740640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 0x7f1148100ed0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f113c00e9f0 tx=0x7f113c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.997+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 shutdown_connections 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.997+0000 7f114d740640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f11300a32c0 0x7f11300a5780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.998+0000 7f114d740640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11481082a0 0x7f1148101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.998+0000 7f114d740640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11481036e0 0x7f1148100ed0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.998+0000 7f114d740640 1 --2- 172.21.15.29:0/2226776254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1148102d30 0x7f1148100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.998+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 >> 172.21.15.29:0/2226776254 conn(0x7f11480fc7d0 msgr2=0x7f1148105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.998+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 shutdown_connections 2024-09-19T07:06:46.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:46.998+0000 7f114d740640 1 -- 172.21.15.29:0/2226776254 wait complete. 2024-09-19T07:06:47.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:46 smithi078 ceph-mon[34556]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:47.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:46 smithi046 ceph-mon[34147]: pgmap v304: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T07:06:47.955 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T07:06:47.956 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T07:06:47.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:47.956 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-09-19T07:06:47.974 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T07:06:47.974 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T07:06:47.974 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T07:06:47.974 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:06:47.974 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-09-19T07:06:47.974 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42272sec preferred_lft 42272sec 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:06:47.975 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:06:47.976 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-09-19T07:06:47.976 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-09-19T07:06:47.976 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T07:06:47.977 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:06:48.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:06:48.172 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:47 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2226776254' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:06:48.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:48.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:48.194 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T07:06:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:47 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2226776254' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:06:48.221 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-09-19T07:06:48.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:48.223 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-09-19T07:06:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:47 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2226776254' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:06:48.292 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-09-19T07:06:48.292 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T07:06:48.292 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T07:06:48.292 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T07:06:48.292 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T07:06:48.293 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:06:48.293 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:06:48.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T07:06:48.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T07:06:48.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T07:06:48.293 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:06:48.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:06:48.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:48.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:48.653 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-19T07:06:48.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:48.670 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-09-19T07:06:48.726 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:06:48.726 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:06:48.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T07:06:48.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T07:06:48.726 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:06:48.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:06:48.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:48.848 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T07:06:48.848 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:06:48.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:06:48.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:49.000 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:06:49.000 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:06:49.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-09-19T07:06:49.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T07:06:49.001 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:06:49.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:06:49.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:49.081 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T07:06:49.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:06:49.081 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:49.097 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T07:06:49.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:06:49.097 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:49.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:48 smithi029 ceph-mon[31255]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:49.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-19T07:06:49.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:48 smithi078 ceph-mon[34556]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:49.206 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T07:06:49.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:48 smithi046 ceph-mon[34147]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:49.262 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-09-19T07:06:49.263 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-09-19T07:06:49.264 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/380678ae24b40c58713f27e79ab23876d8dac81bfc361e2a4d11a6cf89379f40/merged 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d6498f99a7a53c75d3101d65dbb6a359291293f306de33114f3086aad3ceb25c/merged 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/0 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/827dba2d8fc3d10abb58064bb852b0749ef6928b4c1f4527465ca8d4f7f41448/merged 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/cde6d7df95f33d93928e2ec3c302f37b62f660df8a862b0491859e961ffd693c/merged 2024-09-19T07:06:49.265 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/5d098d964ecf65755b2aa7ea58f700fc711b8f48d395598f3777c00e5c676ca9/merged 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/f782ce7ae49b8a6b26265df4ffd8ff74583ce612c28d7f2ccdd95efc807e03a9/merged 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d8b9ab43c81cb249c6ada9dc6152e12e2c98009902409438d3819143ee8e50d7/merged 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/54fedd9d3ad6221aa692ddca9d7d211f3c63d94128cd8b224b11da9cc2174106/merged 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/7d80652ced8e318f76ba6fa155288891cdef892fc1241b8db60eb2729f06296a/merged 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/14a4da5193bcf3787a82b97339c02a03491b7d056e49b32778e1679063a47abf/merged 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T07:06:49.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:49.267 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-19T07:06:49.320 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T07:06:49.320 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T07:06:49.363 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-19T07:06:49.389 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-09-19T07:06:49.446 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-09-19T07:06:49.447 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/380678ae24b40c58713f27e79ab23876d8dac81bfc361e2a4d11a6cf89379f40/merged 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d6498f99a7a53c75d3101d65dbb6a359291293f306de33114f3086aad3ceb25c/merged 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/0 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/827dba2d8fc3d10abb58064bb852b0749ef6928b4c1f4527465ca8d4f7f41448/merged 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/cde6d7df95f33d93928e2ec3c302f37b62f660df8a862b0491859e961ffd693c/merged 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/5d098d964ecf65755b2aa7ea58f700fc711b8f48d395598f3777c00e5c676ca9/merged 2024-09-19T07:06:49.448 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/f782ce7ae49b8a6b26265df4ffd8ff74583ce612c28d7f2ccdd95efc807e03a9/merged 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d8b9ab43c81cb249c6ada9dc6152e12e2c98009902409438d3819143ee8e50d7/merged 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/54fedd9d3ad6221aa692ddca9d7d211f3c63d94128cd8b224b11da9cc2174106/merged 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/7d80652ced8e318f76ba6fa155288891cdef892fc1241b8db60eb2729f06296a/merged 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/14a4da5193bcf3787a82b97339c02a03491b7d056e49b32778e1679063a47abf/merged 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T07:06:49.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:49.449 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-19T07:06:49.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:2024-09-19T07:06:49.471+0000 7fe0e1069480 -1 init, newargv = 0x555bd86f6b50 newargc=15 2024-09-19T07:06:49.472 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[75787]: starting ceph client 2024-09-19T07:06:49.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[75787]: starting fuse 2024-09-19T07:06:49.489 INFO:teuthology.orchestra.run.smithi029.stdout:120 2024-09-19T07:06:49.489 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T07:06:49.489 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-09-19T07:06:49.489 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-09-19T07:06:49.489 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-09-19T07:06:49.489 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-09-19T07:06:49.489 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-09-19T07:06:49.489 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T07:06:49.490 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-09-19T07:06:49.491 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-09-19T07:06:49.491 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-09-19T07:06:49.491 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T07:06:49.491 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:06:49.491 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.admin")) 2024-09-19T07:06:49.491 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-09-19T07:06:49.610 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.admin.75787.asok 2024-09-19T07:06:49.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:49.620 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75787.asok 2024-09-19T07:06:49.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:49.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75787.asok status 2024-09-19T07:06:49.758 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T07:06:49.758 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-09-19T07:06:49.758 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T07:06:49.758 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:06:49.758 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "admin", 2024-09-19T07:06:49.758 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "75787", 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/" 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 14736, 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-09-19T07:06:49.759 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 14736 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1865715633 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 1865715633 2024-09-19T07:06:49.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.14736 192.168.0.1:0/1865715633", 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/1865715633", 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 1, 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 16, 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 88, 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-09-19T07:06:49.761 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-09-19T07:06:49.762 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T07:06:49.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:49.767 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-09-19T07:06:49.767 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:49.784 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-09-19T07:06:49.784 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:49.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:49.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:49.851 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T07:06:49.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:06:49.963 INFO:teuthology.orchestra.run.smithi029.stdout:# file: . 2024-09-19T07:06:49.963 INFO:teuthology.orchestra.run.smithi029.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T07:06:49.963 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:49.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:06:49.969 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:06:49.969 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:06:49.988 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:06:50.284 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:50.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 -- 172.21.15.29:0/1265715307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c100a80 msgr2=0x7fbd0c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:50.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 --2- 172.21.15.29:0/1265715307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c100a80 0x7fbd0c100ee0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009930 tx=0x7fbcf802a420 comp rx=0 tx=0).stop 2024-09-19T07:06:50.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 -- 172.21.15.29:0/1265715307 shutdown_connections 2024-09-19T07:06:50.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 --2- 172.21.15.29:0/1265715307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c101420 0x7fbd0c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 --2- 172.21.15.29:0/1265715307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c100a80 0x7fbd0c100ee0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 --2- 172.21.15.29:0/1265715307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c106a80 0x7fbd0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 -- 172.21.15.29:0/1265715307 >> 172.21.15.29:0/1265715307 conn(0x7fbd0c0fc7a0 msgr2=0x7fbd0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 -- 172.21.15.29:0/1265715307 shutdown_connections 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.777+0000 7fbd12eed640 1 -- 172.21.15.29:0/1265715307 wait complete. 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 Processor -- start 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 -- start start 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c100a80 0x7fbd0c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 0x7fbd0c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c106a80 0x7fbd0c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c110da0 con 0x7fbd0c101420 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c110c20 con 0x7fbd0c100a80 2024-09-19T07:06:50.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd12eed640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c110f20 con 0x7fbd0c106a80 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd0bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 0x7fbd0c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd0bfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 0x7fbd0c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35098/0 (socket says 172.21.15.29:35098) 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.778+0000 7fbd0bfff640 1 -- 172.21.15.29:0/3858742882 learned_addr learned my addr 172.21.15.29:0/3858742882 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd10c89640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c100a80 0x7fbd0c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd1148a640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c106a80 0x7fbd0c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd0bfff640 1 -- 172.21.15.29:0/3858742882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c106a80 msgr2=0x7fbd0c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd0bfff640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c106a80 0x7fbd0c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd0bfff640 1 -- 172.21.15.29:0/3858742882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c100a80 msgr2=0x7fbd0c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd0bfff640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c100a80 0x7fbd0c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd0bfff640 1 -- 172.21.15.29:0/3858742882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c19d420 con 0x7fbd0c101420 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd10c89640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c100a80 0x7fbd0c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd0bfff640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 0x7fbd0c1989b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8031440 tx=0x7fbcf8003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:50.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf803f070 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbcf8031d60 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c19d6b0 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.779+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8035030 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.780+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c1a4ff0 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.781+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd0c1021c0 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.782+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbcf8042070 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.782+0000 7fbd09ffb640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcfc0a3240 0x7fbcfc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.783+0000 7fbd10c89640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcfc0a3240 0x7fbcfc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.783+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fbcf80f0960 con 0x7fbd0c101420 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.783+0000 7fbd10c89640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcfc0a3240 0x7fbcfc0a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009930 tx=0x7fbd00008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:50.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.786+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcf80bd3e0 con 0x7fbd0c101420 2024-09-19T07:06:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.974+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbd0c100ee0 con 0x7fbd0c101420 2024-09-19T07:06:50.975 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:50 smithi029 ceph-mon[31255]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:50.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.974+0000 7fbd09ffb640 1 -- 172.21.15.29:0/3858742882 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+590 (secure 0 0 0) 0x7fbcf80bcce0 con 0x7fbd0c101420 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1356479078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4183681078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/48340936 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4173493605 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3569463944 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:50.976 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:50.977 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1689760555 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:50.977 INFO:teuthology.orchestra.run.smithi029.stderr:listed 10 entries 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.976+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcfc0a3240 msgr2=0x7fbcfc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.976+0000 7fbd12eed640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcfc0a3240 0x7fbcfc0a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009930 tx=0x7fbd00008040 comp rx=0 tx=0).stop 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.976+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 msgr2=0x7fbd0c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.976+0000 7fbd12eed640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 0x7fbd0c1989b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8031440 tx=0x7fbcf8003d50 comp rx=0 tx=0).stop 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.976+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 shutdown_connections 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbcfc0a3240 0x7fbcfc0a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0c106a80 0x7fbd0c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbd0c101420 0x7fbd0c1989b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 --2- 172.21.15.29:0/3858742882 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbd0c100a80 0x7fbd0c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 >> 172.21.15.29:0/3858742882 conn(0x7fbd0c0fc7a0 msgr2=0x7fbd0c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 shutdown_connections 2024-09-19T07:06:50.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:50.977+0000 7fbd12eed640 1 -- 172.21.15.29:0/3858742882 wait complete. 2024-09-19T07:06:51.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:50 smithi078 ceph-mon[34556]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:51.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:50 smithi046 ceph-mon[34147]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:51.811 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:06:51.811 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:06:51.831 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:06:52.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:51 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3858742882' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:52.135 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:51 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3858742882' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:52.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:51 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3858742882' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 -- 172.21.15.29:0/1130512282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 msgr2=0x7f70e810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/1130512282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e810e610 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009ca0 tx=0x7f70e002a950 comp rx=0 tx=0).stop 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 -- 172.21.15.29:0/1130512282 shutdown_connections 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/1130512282 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e810e610 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/1130512282 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8103700 0x7f70e810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/1130512282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8102de0 0x7f70e81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 -- 172.21.15.29:0/1130512282 >> 172.21.15.29:0/1130512282 conn(0x7f70e80fc7a0 msgr2=0x7f70e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 -- 172.21.15.29:0/1130512282 shutdown_connections 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.589+0000 7f70ef1a8640 1 -- 172.21.15.29:0/1130512282 wait complete. 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 Processor -- start 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 -- start start 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8102de0 0x7f70e8100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8103700 0x7f70e8100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e81014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8111de0 con 0x7f70e810c180 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8111c60 con 0x7f70e8102de0 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ef1a8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f70e8111f60 con 0x7f70e8103700 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e81014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e81014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35116/0 (socket says 172.21.15.29:35116) 2024-09-19T07:06:52.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 -- 172.21.15.29:0/565181353 learned_addr learned my addr 172.21.15.29:0/565181353 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ecf44640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8102de0 0x7f70e8100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70dffff640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8103700 0x7f70e8100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 -- 172.21.15.29:0/565181353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8103700 msgr2=0x7f70e8100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8103700 0x7f70e8100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 -- 172.21.15.29:0/565181353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8102de0 msgr2=0x7f70e8100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8102de0 0x7f70e8100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ed745640 1 -- 172.21.15.29:0/565181353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e81aac50 con 0x7f70e810c180 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70dffff640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8103700 0x7f70e8100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.590+0000 7f70ecf44640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8102de0 0x7f70e8100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.591+0000 7f70ed745640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e81014c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70e0006010 tx=0x7f70e002f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.591+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0034040 con 0x7f70e810c180 2024-09-19T07:06:52.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.591+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e81aae20 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.591+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f70e0003e00 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.591+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0045480 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.591+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e81ab320 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.592+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70e806afd0 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.593+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f70e0037020 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.594+0000 7f70ddffb640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70d00a3240 0x7f70d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.594+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f70e00f0ee0 con 0x7f70e810c180 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.594+0000 7f70ecf44640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70d00a3240 0x7f70d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.595+0000 7f70ecf44640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70d00a3240 0x7f70d00a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70e400baa0 tx=0x7f70e4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:52.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.597+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70e0081210 con 0x7f70e810c180 2024-09-19T07:06:52.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.784+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f70e81031c0 con 0x7f70e810c180 2024-09-19T07:06:52.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.784+0000 7f70ddffb640 1 -- 172.21.15.29:0/565181353 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+590 (secure 0 0 0) 0x7f70e81031c0 con 0x7f70e810c180 2024-09-19T07:06:52.785 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1356479078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4183681078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/48340936 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4173493605 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3569463944 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:52.786 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:52.787 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:52.787 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1689760555 2024-09-20T06:58:48.466085+0000 2024-09-19T07:06:52.788 INFO:teuthology.orchestra.run.smithi029.stderr:listed 10 entries 2024-09-19T07:06:52.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70d00a3240 msgr2=0x7f70d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:52.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70d00a3240 0x7f70d00a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70e400baa0 tx=0x7f70e4005d90 comp rx=0 tx=0).stop 2024-09-19T07:06:52.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 msgr2=0x7f70e81014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:52.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e81014c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70e0006010 tx=0x7f70e002f640 comp rx=0 tx=0).stop 2024-09-19T07:06:52.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 shutdown_connections 2024-09-19T07:06:52.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70e810c180 0x7f70e81014c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f70d00a3240 0x7f70d00a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8103700 0x7f70e8100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 --2- 172.21.15.29:0/565181353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70e8102de0 0x7f70e8100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:52.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 >> 172.21.15.29:0/565181353 conn(0x7f70e80fc7a0 msgr2=0x7f70e80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:52.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 shutdown_connections 2024-09-19T07:06:52.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:52.787+0000 7f70ef1a8640 1 -- 172.21.15.29:0/565181353 wait complete. 2024-09-19T07:06:53.114 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:52 smithi029 ceph-mon[31255]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:53.115 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:52 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/565181353' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:53.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:52 smithi078 ceph-mon[34556]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:53.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:52 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/565181353' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:53.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:52 smithi046 ceph-mon[34147]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:06:53.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:52 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/565181353' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:53.570 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-09-19T07:06:53.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:53.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T07:06:53.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi029.stderr:ceph-fuse[75787]: fuse finished with error 0 and tester_r 0 2024-09-19T07:06:53.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T07:06:53.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T07:06:53.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:53.656 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T07:06:53.698 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:06:53.999 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:54.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 -- 172.21.15.29:0/1678589674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074f40 msgr2=0x7f682c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 --2- 172.21.15.29:0/1678589674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074f40 0x7f682c10de80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6820009900 tx=0x7f682002a480 comp rx=0 tx=0).stop 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 -- 172.21.15.29:0/1678589674 shutdown_connections 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 --2- 172.21.15.29:0/1678589674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c10e3c0 0x7f682c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 --2- 172.21.15.29:0/1678589674 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074f40 0x7f682c10de80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 --2- 172.21.15.29:0/1678589674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c074620 0x7f682c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 -- 172.21.15.29:0/1678589674 >> 172.21.15.29:0/1678589674 conn(0x7f682c0fd8c0 msgr2=0x7f682c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 -- 172.21.15.29:0/1678589674 shutdown_connections 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 -- 172.21.15.29:0/1678589674 wait complete. 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.494+0000 7f6833d42640 1 Processor -- start 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 -- start start 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 0x7f682c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:54.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c074f40 0x7f682c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c10e3c0 0x7f682c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f682c114010 con 0x7f682c074620 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f682c113e90 con 0x7f682c10e3c0 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6833d42640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f682c114190 con 0x7f682c074f40 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 0x7f682c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 0x7f682c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:35140/0 (socket says 172.21.15.29:35140) 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 -- 172.21.15.29:0/2457509960 learned_addr learned my addr 172.21.15.29:0/2457509960 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f68312dd640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c074f40 0x7f682c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f68322df640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c10e3c0 0x7f682c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:54.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 -- 172.21.15.29:0/2457509960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c074f40 msgr2=0x7f682c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c074f40 0x7f682c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 -- 172.21.15.29:0/2457509960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c10e3c0 msgr2=0x7f682c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c10e3c0 0x7f682c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f6831ade640 1 -- 172.21.15.29:0/2457509960 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c19f5c0 con 0x7f682c074620 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f68322df640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c10e3c0 0x7f682c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.495+0000 7f68312dd640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c074f40 0x7f682c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.496+0000 7f6831ade640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 0x7f682c19a610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c920 tx=0x7f681c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.496+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c007c70 con 0x7f682c074620 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.496+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f681c007e10 con 0x7f682c074620 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.496+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c19f8b0 con 0x7f682c074620 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.496+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c018820 con 0x7f682c074620 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.496+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c1a7190 con 0x7f682c074620 2024-09-19T07:06:54.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.497+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c074a00 con 0x7f682c074620 2024-09-19T07:06:54.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.498+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f681c0189c0 con 0x7f682c074620 2024-09-19T07:06:54.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.499+0000 7f682affd640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f68140a32c0 0x7f68140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:54.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.499+0000 7f68312dd640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f68140a32c0 0x7f68140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:54.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.499+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f681c0cfc60 con 0x7f682c074620 2024-09-19T07:06:54.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.500+0000 7f68312dd640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f68140a32c0 0x7f68140a5780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6820031440 tx=0x7f6820005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:54.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.503+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f681c014030 con 0x7f682c074620 2024-09-19T07:06:54.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.683+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f682c109540 con 0x7f682c074620 2024-09-19T07:06:54.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.685+0000 7f682affd640 1 -- 172.21.15.29:0/2457509960 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24128 (secure 0 0 0) 0x7f681c09c740 con 0x7f682c074620 2024-09-19T07:06:54.688 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:54.688 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":88,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:06:34.683258+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:06:54.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f68140a32c0 msgr2=0x7f68140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:54.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f68140a32c0 0x7f68140a5780 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6820031440 tx=0x7f6820005b50 comp rx=0 tx=0).stop 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 msgr2=0x7f682c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 0x7f682c19a610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c920 tx=0x7f681c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 shutdown_connections 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f682c10e3c0 0x7f682c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f68140a32c0 0x7f68140a5780 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c074f40 0x7f682c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 --2- 172.21.15.29:0/2457509960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f682c074620 0x7f682c19a610 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 >> 172.21.15.29:0/2457509960 conn(0x7f682c0fd8c0 msgr2=0x7f682c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 shutdown_connections 2024-09-19T07:06:54.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:54.687+0000 7f6833d42640 1 -- 172.21.15.29:0/2457509960 wait complete. 2024-09-19T07:06:55.063 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:54 smithi029 ceph-mon[31255]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T07:06:55.063 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:54 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2457509960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:55.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:54 smithi078 ceph-mon[34556]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T07:06:55.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:54 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2457509960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:55.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:54 smithi046 ceph-mon[34147]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T07:06:55.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:54 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2457509960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:55.414 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:06:55.673 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:56.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 -- 172.21.15.29:0/570813390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 msgr2=0x7fea2010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 --2- 172.21.15.29:0/570813390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea2010ea90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fea18009ca0 tx=0x7fea1802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 -- 172.21.15.29:0/570813390 shutdown_connections 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 --2- 172.21.15.29:0/570813390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea2010ea90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 --2- 172.21.15.29:0/570813390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea20102790 0x7fea201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 --2- 172.21.15.29:0/570813390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea20101de0 0x7fea201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 -- 172.21.15.29:0/570813390 >> 172.21.15.29:0/570813390 conn(0x7fea200fd8c0 msgr2=0x7fea200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 -- 172.21.15.29:0/570813390 shutdown_connections 2024-09-19T07:06:56.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.141+0000 7fea2601a640 1 -- 172.21.15.29:0/570813390 wait complete. 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 Processor -- start 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 -- start start 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111e20 con 0x7fea20106f10 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111ca0 con 0x7fea20101de0 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea2601a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fea20111fa0 con 0x7fea20102790 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea1ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33986/0 (socket says 172.21.15.29:33986) 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea1ffff640 1 -- 172.21.15.29:0/4145840084 learned_addr learned my addr 172.21.15.29:0/4145840084 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea1f7fe640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:56.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.142+0000 7fea1effd640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1ffff640 1 -- 172.21.15.29:0/4145840084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea20102790 msgr2=0x7fea20074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1ffff640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1ffff640 1 -- 172.21.15.29:0/4145840084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea20101de0 msgr2=0x7fea200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1ffff640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1ffff640 1 -- 172.21.15.29:0/4145840084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea201a6760 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1ffff640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea20074f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea18009dc0 tx=0x7fea18032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18003bf0 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fea18003d90 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea201a69f0 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18030ac0 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.143+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea201a6f30 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.144+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea201021c0 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.145+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fea18004610 con 0x7fea20106f10 2024-09-19T07:06:56.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.146+0000 7fea1cff9640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fea080a3240 0x7fea080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:56.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.146+0000 7fea1f7fe640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fea080a3240 0x7fea080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:56.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.146+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fea180f1260 con 0x7fea20106f10 2024-09-19T07:06:56.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.146+0000 7fea1f7fe640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fea080a3240 0x7fea080a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea1000abe0 tx=0x7fea1000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:56.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.150+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea180bdd40 con 0x7fea20106f10 2024-09-19T07:06:56.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.327+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea2010a0f0 con 0x7fea20106f10 2024-09-19T07:06:56.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.329+0000 7fea1cff9640 1 -- 172.21.15.29:0/4145840084 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24128 (secure 0 0 0) 0x7fea180b9030 con 0x7fea20106f10 2024-09-19T07:06:56.330 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:06:56.335 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":88,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:06:34.683258+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:06:56.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fea080a3240 msgr2=0x7fea080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fea080a3240 0x7fea080a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea1000abe0 tx=0x7fea1000a2d0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 msgr2=0x7fea20074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea20074f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fea18009dc0 tx=0x7fea18032ff0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 shutdown_connections 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea20106f10 0x7fea20074f70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fea080a3240 0x7fea080a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea20102790 0x7fea20074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 --2- 172.21.15.29:0/4145840084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea20101de0 0x7fea200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.331+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 >> 172.21.15.29:0/4145840084 conn(0x7fea200fd8c0 msgr2=0x7fea200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.332+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 shutdown_connections 2024-09-19T07:06:56.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:56.332+0000 7fea2601a640 1 -- 172.21.15.29:0/4145840084 wait complete. 2024-09-19T07:06:57.351 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:56 smithi029 ceph-mon[31255]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T07:06:57.352 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:56 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4145840084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:57.382 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T07:06:57.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:56 smithi078 ceph-mon[34556]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T07:06:57.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:56 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4145840084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:57.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:56 smithi046 ceph-mon[34147]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T07:06:57.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:56 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4145840084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:06:57.646 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:06:58.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 -- 172.21.15.29:0/1576989264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102570 msgr2=0x7fc4101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 --2- 172.21.15.29:0/1576989264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102570 0x7fc4101029b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc400009900 tx=0x7fc40002a480 comp rx=0 tx=0).stop 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 -- 172.21.15.29:0/1576989264 shutdown_connections 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 --2- 172.21.15.29:0/1576989264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc410102ef0 0x7fc41010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 --2- 172.21.15.29:0/1576989264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102570 0x7fc4101029b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 --2- 172.21.15.29:0/1576989264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410100e20 0x7fc410101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 -- 172.21.15.29:0/1576989264 >> 172.21.15.29:0/1576989264 conn(0x7fc4100fc7d0 msgr2=0x7fc4100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 -- 172.21.15.29:0/1576989264 shutdown_connections 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.152+0000 7fc417819640 1 -- 172.21.15.29:0/1576989264 wait complete. 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 Processor -- start 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 -- start start 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc410100e20 0x7fc4100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:58.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410102570 0x7fc4100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 0x7fc4100fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc410110e30 con 0x7fc410102ef0 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc410110cb0 con 0x7fc410102570 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc417819640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc410110fb0 con 0x7fc410100e20 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 0x7fc4100fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 0x7fc4100fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:33994/0 (socket says 172.21.15.29:33994) 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 -- 172.21.15.29:0/883942223 learned_addr learned my addr 172.21.15.29:0/883942223 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc4155b5640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc410100e20 0x7fc4100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc414db4640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410102570 0x7fc4100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 -- 172.21.15.29:0/883942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc410100e20 msgr2=0x7fc4100fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc410100e20 0x7fc4100fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:58.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 -- 172.21.15.29:0/883942223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410102570 msgr2=0x7fc4100fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410102570 0x7fc4100fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc415db6640 1 -- 172.21.15.29:0/883942223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4101a6840 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.153+0000 7fc414db4640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410102570 0x7fc4100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.154+0000 7fc415db6640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 0x7fc4100fd700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc40800eaa0 tx=0x7fc40800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.154+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40800cdb0 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.154+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4101a6b30 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.154+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc408005020 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.154+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080116d0 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.154+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4101a7070 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.155+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc410101200 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.156+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc4080051d0 con 0x7fc410102ef0 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.157+0000 7fc4067fc640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:58.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.157+0000 7fc4155b5640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.157+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fc4080cfdc0 con 0x7fc410102ef0 2024-09-19T07:06:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.157+0000 7fc4155b5640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc40c005e10 tx=0x7fc40c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:58.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.161+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc408016030 con 0x7fc410102ef0 2024-09-19T07:06:58.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.375+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc4100fe110 con 0x7fc410102ef0 2024-09-19T07:06:58.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.996+0000 7fc4067fc640 1 -- 172.21.15.29:0/883942223 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc4100fe110 con 0x7fc410102ef0 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3fc0a3240 msgr2=0x7fc3fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc40c005e10 tx=0x7fc40c005da0 comp rx=0 tx=0).stop 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 msgr2=0x7fc4100fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 0x7fc4100fd700 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc40800eaa0 tx=0x7fc40800ef60 comp rx=0 tx=0).stop 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 shutdown_connections 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc410102ef0 0x7fc4100fd700 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc410102570 0x7fc4100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:59.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3fc0a3240 0x7fc3fc0a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 --2- 172.21.15.29:0/883942223 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc410100e20 0x7fc4100fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 >> 172.21.15.29:0/883942223 conn(0x7fc4100fc7d0 msgr2=0x7fc41006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:58.999+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 shutdown_connections 2024-09-19T07:06:59.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:06:59.000+0000 7fc417819640 1 -- 172.21.15.29:0/883942223 wait complete. 2024-09-19T07:06:59.369 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:58 smithi029 ceph-mon[31255]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T07:06:59.369 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:06:58 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/883942223' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:06:59.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:58 smithi078 ceph-mon[34556]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T07:06:59.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:06:58 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/883942223' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:06:59.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:58 smithi046 ceph-mon[34147]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T07:06:59.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:06:58 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/883942223' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:06:59.902 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T07:06:59.902 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T07:07:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:00 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/883942223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:07:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:00 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:07:00.169 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:00.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:00 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/883942223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:07:00.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:00 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:07:00.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:00 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/883942223' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:07:00.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:00 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:07:00.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 -- 172.21.15.29:0/221345417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 msgr2=0x7f9ac410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:00.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/221345417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac410ea90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009ca0 tx=0x7f9abc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:00.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 -- 172.21.15.29:0/221345417 shutdown_connections 2024-09-19T07:07:00.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/221345417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac410ea90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:00.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/221345417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac4102790 0x7f9ac41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/221345417 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 0x7f9ac41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 -- 172.21.15.29:0/221345417 >> 172.21.15.29:0/221345417 conn(0x7f9ac40fd8c0 msgr2=0x7f9ac40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 -- 172.21.15.29:0/221345417 shutdown_connections 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.647+0000 7f9ac9caf640 1 -- 172.21.15.29:0/221345417 wait complete. 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 Processor -- start 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 -- start start 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 0x7f9ac4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac4102790 0x7f9ac4198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4111e20 con 0x7f9ac4106f10 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4111ca0 con 0x7f9ac4102790 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.648+0000 7f9ac9caf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4111fa0 con 0x7f9ac4101de0 2024-09-19T07:07:00.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34010/0 (socket says 172.21.15.29:34010) 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 -- 172.21.15.29:0/3425337464 learned_addr learned my addr 172.21.15.29:0/3425337464 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac2ffd640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac4102790 0x7f9ac4198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac37fe640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 0x7f9ac4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 -- 172.21.15.29:0/3425337464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 msgr2=0x7f9ac4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 0x7f9ac4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 -- 172.21.15.29:0/3425337464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac4102790 msgr2=0x7f9ac4198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac4102790 0x7f9ac4198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 -- 172.21.15.29:0/3425337464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac419d2d0 con 0x7f9ac4106f10 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac37fe640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 0x7f9ac4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:00.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac3fff640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac419cbf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009dc0 tx=0x7f9abc032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc003bf0 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9abc003d90 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc030b80 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac419d560 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.649+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac41a4ea0 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.650+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac41021c0 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.651+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9abc004040 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.652+0000 7f9ac0ff9640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9aac0a3240 0x7f9aac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.652+0000 7f9ac37fe640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9aac0a3240 0x7f9aac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.652+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f9abc0f11d0 con 0x7f9ac4106f10 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.653+0000 7f9ac37fe640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9aac0a3240 0x7f9aac0a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009c20 tx=0x7f9ab4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:00.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.656+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9abc0bdcb0 con 0x7f9ac4106f10 2024-09-19T07:07:00.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:00.868+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f9ac4199680 con 0x7f9ac4106f10 2024-09-19T07:07:01.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.003+0000 7f9ac0ff9640 1 -- 172.21.15.29:0/3425337464 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f9abc0bd5b0 con 0x7f9ac4106f10 2024-09-19T07:07:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9aac0a3240 msgr2=0x7f9aac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9aac0a3240 0x7f9aac0a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009c20 tx=0x7f9ab4005f90 comp rx=0 tx=0).stop 2024-09-19T07:07:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 msgr2=0x7f9ac419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac419cbf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009dc0 tx=0x7f9abc032ff0 comp rx=0 tx=0).stop 2024-09-19T07:07:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 shutdown_connections 2024-09-19T07:07:01.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ac4106f10 0x7f9ac419cbf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:01.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ac4102790 0x7f9ac4198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:01.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9aac0a3240 0x7f9aac0a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:01.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 --2- 172.21.15.29:0/3425337464 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ac4101de0 0x7f9ac4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:01.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 >> 172.21.15.29:0/3425337464 conn(0x7f9ac40fd8c0 msgr2=0x7f9ac40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:01.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 shutdown_connections 2024-09-19T07:07:01.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:01.005+0000 7f9ac9caf640 1 -- 172.21.15.29:0/3425337464 wait complete. 2024-09-19T07:07:01.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:01 smithi029 ceph-mon[31255]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T07:07:01.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:01 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3425337464' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:07:01.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:01 smithi078 ceph-mon[34556]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T07:07:01.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:01 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3425337464' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:07:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:01 smithi046 ceph-mon[34147]: pgmap v311: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T07:07:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:01 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3425337464' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:07:01.841 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T07:07:02.108 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:02 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3425337464' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:07:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:02 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:07:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:02 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T07:07:02.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:02 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3425337464' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:07:02.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:02 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:07:02.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:02 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T07:07:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:02 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3425337464' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:07:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:02 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T07:07:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:02 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T07:07:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 -- 172.21.15.29:0/3902121559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 msgr2=0x7f535c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3902121559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c103180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f534c009900 tx=0x7f534c02a480 comp rx=0 tx=0).stop 2024-09-19T07:07:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 -- 172.21.15.29:0/3902121559 shutdown_connections 2024-09-19T07:07:02.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3902121559 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c10c180 0x7f535c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3902121559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f535c1036c0 0x7f535c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3902121559 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c103180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 -- 172.21.15.29:0/3902121559 >> 172.21.15.29:0/3902121559 conn(0x7f535c0fc7a0 msgr2=0x7f535c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.586+0000 7f5360aa1640 1 -- 172.21.15.29:0/3902121559 shutdown_connections 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.587+0000 7f5360aa1640 1 -- 172.21.15.29:0/3902121559 wait complete. 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.587+0000 7f5360aa1640 1 Processor -- start 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.587+0000 7f5360aa1640 1 -- start start 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.587+0000 7f5360aa1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5360aa1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f535c1036c0 0x7f535c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5360aa1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c10c180 0x7f535c19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5360aa1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f535c111e60 con 0x7f535c102da0 2024-09-19T07:07:02.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5360aa1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f535c111ce0 con 0x7f535c1036c0 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5360aa1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f535c111fe0 con 0x7f535c10c180 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34030/0 (socket says 172.21.15.29:34030) 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 -- 172.21.15.29:0/3790558813 learned_addr learned my addr 172.21.15.29:0/3790558813 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535ad9d640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c10c180 0x7f535c19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5359d9b640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f535c1036c0 0x7f535c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 -- 172.21.15.29:0/3790558813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c10c180 msgr2=0x7f535c19ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c10c180 0x7f535c19ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 -- 172.21.15.29:0/3790558813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f535c1036c0 msgr2=0x7f535c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f535c1036c0 0x7f535c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 -- 172.21.15.29:0/3790558813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c19f4e0 con 0x7f535c102da0 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f535a59c640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c19a5d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f534c005ab0 tx=0x7f534c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:02.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c03f070 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.588+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c19f770 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.589+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f534c031d60 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.589+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534c035030 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.589+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c1a70b0 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.590+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c06b010 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.591+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f534c042070 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.591+0000 7f534b7fe640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f53440a3240 0x7f53440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.592+0000 7f5359d9b640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f53440a3240 0x7f53440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.592+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f534c0f03a0 con 0x7f535c102da0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.592+0000 7f5359d9b640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f53440a3240 0x7f53440a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f535c0fec70 tx=0x7f535000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:02.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.596+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f534c0bc830 con 0x7f535c102da0 2024-09-19T07:07:02.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:02.813+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f535c1a7280 con 0x7f535c102da0 2024-09-19T07:07:03.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.013+0000 7f534b7fe640 1 -- 172.21.15.29:0/3790558813 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f534c0c0b30 con 0x7f535c102da0 2024-09-19T07:07:03.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f53440a3240 msgr2=0x7f53440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f53440a3240 0x7f53440a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f535c0fec70 tx=0x7f535000a2d0 comp rx=0 tx=0).stop 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 msgr2=0x7f535c19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c19a5d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f534c005ab0 tx=0x7f534c003cd0 comp rx=0 tx=0).stop 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 shutdown_connections 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f53440a3240 0x7f53440a5700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c10c180 0x7f535c19ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f535c1036c0 0x7f535c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 --2- 172.21.15.29:0/3790558813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f535c102da0 0x7f535c19a5d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 >> 172.21.15.29:0/3790558813 conn(0x7f535c0fc7a0 msgr2=0x7f535c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 shutdown_connections 2024-09-19T07:07:03.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:03.017+0000 7f5360aa1640 1 -- 172.21.15.29:0/3790558813 wait complete. 2024-09-19T07:07:03.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:03 smithi029 ceph-mon[31255]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 426 B/s wr, 0 op/s 2024-09-19T07:07:03.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:03 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3790558813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:07:03.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:03 smithi078 ceph-mon[34556]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 426 B/s wr, 0 op/s 2024-09-19T07:07:03.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:03 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3790558813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:07:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:03 smithi046 ceph-mon[34147]: pgmap v312: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 426 B/s wr, 0 op/s 2024-09-19T07:07:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:03 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3790558813' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:07:03.742 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T07:07:03.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T07:07:04.005 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:04.283 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3790558813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:07:04.284 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-mon[31255]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T07:07:04.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:04 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3790558813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:07:04.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:04 smithi078 ceph-mon[34556]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T07:07:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:04 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3790558813' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:07:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:04 smithi046 ceph-mon[34147]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T07:07:04.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3203774944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8101de0 msgr2=0x7fc3d81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3203774944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8101de0 0x7fc3d81021c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009900 tx=0x7fc3d402a410 comp rx=0 tx=0).stop 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3203774944 shutdown_connections 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3203774944 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3d8106f10 0x7fc3d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3203774944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8102790 0x7fc3d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3203774944 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8101de0 0x7fc3d81021c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3203774944 >> 172.21.15.29:0/3203774944 conn(0x7fc3d80fd8c0 msgr2=0x7fc3d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3203774944 shutdown_connections 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.528+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3203774944 wait complete. 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 Processor -- start 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 -- start start 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8101de0 0x7fc3d8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:04.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3d8102790 0x7fc3d81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 0x7fc3d819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8111e20 con 0x7fc3d8106f10 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8111ca0 con 0x7fc3d8101de0 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3e03ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8111fa0 con 0x7fc3d8102790 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3de989640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 0x7fc3d819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3de989640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 0x7fc3d819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34046/0 (socket says 172.21.15.29:34046) 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3de989640 1 -- 172.21.15.29:0/3199398442 learned_addr learned my addr 172.21.15.29:0/3199398442 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3de188640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8101de0 0x7fc3d8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.529+0000 7fc3dd987640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3d8102790 0x7fc3d81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3de989640 1 -- 172.21.15.29:0/3199398442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3d8102790 msgr2=0x7fc3d81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3de989640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3d8102790 0x7fc3d81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3de989640 1 -- 172.21.15.29:0/3199398442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8101de0 msgr2=0x7fc3d8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3de989640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8101de0 0x7fc3d8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3de989640 1 -- 172.21.15.29:0/3199398442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d819d310 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3de989640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 0x7fc3d819cc30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000eb10 tx=0x7fc3d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0004b20 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3d0004cc0 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0010690 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d819d600 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.530+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d81a4ee0 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.531+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d81021c0 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.532+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc3d0005020 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.533+0000 7fc3cf7fe640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3c40a32c0 0x7fc3c40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.533+0000 7fc3de188640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3c40a32c0 0x7fc3c40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.533+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fc3d00d01e0 con 0x7fc3d8106f10 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.533+0000 7fc3de188640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3c40a32c0 0x7fc3c40a5780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4031440 tx=0x7fc3d40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:04.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.537+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3d009cd60 con 0x7fc3d8106f10 2024-09-19T07:07:04.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.735+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fc3d8062630 con 0x7fc3c40a32c0 2024-09-19T07:07:04.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.755+0000 7fc3cf7fe640 1 -- 172.21.15.29:0/3199398442 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc3d8062630 con 0x7fc3c40a32c0 2024-09-19T07:07:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3c40a32c0 msgr2=0x7fc3c40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3c40a32c0 0x7fc3c40a5780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4031440 tx=0x7fc3d40095f0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 msgr2=0x7fc3d819cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 0x7fc3d819cc30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000eb10 tx=0x7fc3d000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 shutdown_connections 2024-09-19T07:07:04.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3d8106f10 0x7fc3d819cc30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3c40a32c0 0x7fc3c40a5780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3d8102790 0x7fc3d81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 --2- 172.21.15.29:0/3199398442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8101de0 0x7fc3d8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 >> 172.21.15.29:0/3199398442 conn(0x7fc3d80fd8c0 msgr2=0x7fc3d80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 shutdown_connections 2024-09-19T07:07:04.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:04.757+0000 7fc3e03ec640 1 -- 172.21.15.29:0/3199398442 wait complete. 2024-09-19T07:07:04.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T07:07:04.740+0000 7fa3c3cef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:07:04.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T07:07:04.740+0000 7fa3c3cef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:07:04.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T07:07:04.740+0000 7fa3c3cef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:07:04.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T07:07:04.740+0000 7fa3c3cef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:07:04.874 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:07:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T07:07:04.740+0000 7fa3c3cef640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:07:05.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:05 smithi078 ceph-mon[34556]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 1 op/s 2024-09-19T07:07:05.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:05 smithi078 ceph-mon[34556]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:05 smithi029 ceph-mon[31255]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 1 op/s 2024-09-19T07:07:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:05 smithi029 ceph-mon[31255]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:05 smithi046 ceph-mon[34147]: pgmap v313: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 426 B/s wr, 1 op/s 2024-09-19T07:07:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:05 smithi046 ceph-mon[34147]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:05.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T07:07:05.752 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 -- 172.21.15.29:0/818591066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30106f10 msgr2=0x7f3f3010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/818591066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30106f10 0x7f3f3010ea90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009ca0 tx=0x7f3f2802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 -- 172.21.15.29:0/818591066 shutdown_connections 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/818591066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30106f10 0x7f3f3010ea90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/818591066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30102790 0x7f3f301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/818591066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f30101de0 0x7f3f301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 -- 172.21.15.29:0/818591066 >> 172.21.15.29:0/818591066 conn(0x7f3f300fd8c0 msgr2=0x7f3f300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 -- 172.21.15.29:0/818591066 shutdown_connections 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 -- 172.21.15.29:0/818591066 wait complete. 2024-09-19T07:07:06.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 Processor -- start 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.217+0000 7f3f35f2b640 1 -- start start 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f35f2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f30101de0 0x7f3f300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f35f2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 0x7f3f30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f35f2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30106f10 0x7f3f30074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f35f2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30111e20 con 0x7f3f30102790 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f35f2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30111ca0 con 0x7f3f30106f10 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f35f2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30111fa0 con 0x7f3f30101de0 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 0x7f3f30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 0x7f3f30074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44270/0 (socket says 172.21.15.29:44270) 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 -- 172.21.15.29:0/1302447251 learned_addr learned my addr 172.21.15.29:0/1302447251 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2f7fe640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f30101de0 0x7f3f300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:06.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2ffff640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30106f10 0x7f3f30074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 -- 172.21.15.29:0/1302447251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f30101de0 msgr2=0x7f3f300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f30101de0 0x7f3f300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 -- 172.21.15.29:0/1302447251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30106f10 msgr2=0x7f3f30074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30106f10 0x7f3f30074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 -- 172.21.15.29:0/1302447251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f301a67e0 con 0x7f3f30102790 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2ffff640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30106f10 0x7f3f30074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2effd640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 0x7f3f30074a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d950 tx=0x7f3f2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24017070 con 0x7f3f30102790 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.218+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f24009c30 con 0x7f3f30102790 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.219+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f301a6ad0 con 0x7f3f30102790 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.219+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400f620 con 0x7f3f30102790 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.219+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f301a7010 con 0x7f3f30102790 2024-09-19T07:07:06.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.219+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f301021c0 con 0x7f3f30102790 2024-09-19T07:07:06.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.221+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3f240109a0 con 0x7f3f30102790 2024-09-19T07:07:06.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.222+0000 7f3f2cff9640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3f180a32d0 0x7f3f180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:06.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.222+0000 7f3f2f7fe640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3f180a32d0 0x7f3f180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:06.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.222+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f3f240cf8d0 con 0x7f3f30102790 2024-09-19T07:07:06.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.222+0000 7f3f2f7fe640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3f180a32d0 0x7f3f180a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009bd0 tx=0x7f3f20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:06.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.225+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f24009de0 con 0x7f3f30102790 2024-09-19T07:07:06.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.425+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3f30062630 con 0x7f3f180a32d0 2024-09-19T07:07:06.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.453+0000 7f3f2cff9640 1 -- 172.21.15.29:0/1302447251 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3f30062630 con 0x7f3f180a32d0 2024-09-19T07:07:06.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3f180a32d0 msgr2=0x7f3f180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3f180a32d0 0x7f3f180a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009bd0 tx=0x7f3f20005f90 comp rx=0 tx=0).stop 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 msgr2=0x7f3f30074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 0x7f3f30074a30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d950 tx=0x7f3f2400de10 comp rx=0 tx=0).stop 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 shutdown_connections 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f30106f10 0x7f3f30074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f30102790 0x7f3f30074a30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f3f180a32d0 0x7f3f180a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 --2- 172.21.15.29:0/1302447251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f30101de0 0x7f3f300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 >> 172.21.15.29:0/1302447251 conn(0x7f3f300fd8c0 msgr2=0x7f3f300fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:06.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 shutdown_connections 2024-09-19T07:07:06.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:06.455+0000 7f3f35f2b640 1 -- 172.21.15.29:0/1302447251 wait complete. 2024-09-19T07:07:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:07 smithi029 ceph-mon[31255]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T07:07:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:07 smithi029 ceph-mon[31255]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T07:07:07.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:07 smithi029 ceph-mon[31255]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:07.170 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T07:07:07.432 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:07 smithi078 ceph-mon[34556]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T07:07:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:07 smithi078 ceph-mon[34556]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T07:07:07.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:07 smithi078 ceph-mon[34556]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:07 smithi046 ceph-mon[34147]: pgmap v314: 129 pgs: 129 active+clean; 581 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-19T07:07:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:07 smithi046 ceph-mon[34147]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T07:07:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:07 smithi046 ceph-mon[34147]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 -- 172.21.15.29:0/3880326905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4102790 msgr2=0x7f38b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 --2- 172.21.15.29:0/3880326905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4102790 0x7f38b41067e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009900 tx=0x7f38a802a410 comp rx=0 tx=0).stop 2024-09-19T07:07:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 -- 172.21.15.29:0/3880326905 shutdown_connections 2024-09-19T07:07:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 --2- 172.21.15.29:0/3880326905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b4106f10 0x7f38b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 --2- 172.21.15.29:0/3880326905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4102790 0x7f38b41067e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 --2- 172.21.15.29:0/3880326905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b4101de0 0x7f38b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 -- 172.21.15.29:0/3880326905 >> 172.21.15.29:0/3880326905 conn(0x7f38b40fd8c0 msgr2=0x7f38b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 -- 172.21.15.29:0/3880326905 shutdown_connections 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.900+0000 7f38b9104640 1 -- 172.21.15.29:0/3880326905 wait complete. 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 Processor -- start 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 -- start start 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 0x7f38b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b4102790 0x7f38b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b4106f10 0x7f38b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4111e20 con 0x7f38b4101de0 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4111ca0 con 0x7f38b4106f10 2024-09-19T07:07:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b9104640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f38b4111fa0 con 0x7f38b4102790 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 0x7f38b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b2d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 0x7f38b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44284/0 (socket says 172.21.15.29:44284) 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b2d9d640 1 -- 172.21.15.29:0/4215344068 learned_addr learned my addr 172.21.15.29:0/4215344068 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b359e640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b4106f10 0x7f38b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.901+0000 7f38b259c640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b4102790 0x7f38b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b2d9d640 1 -- 172.21.15.29:0/4215344068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b4102790 msgr2=0x7f38b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b2d9d640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b4102790 0x7f38b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b2d9d640 1 -- 172.21.15.29:0/4215344068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b4106f10 msgr2=0x7f38b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b2d9d640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b4106f10 0x7f38b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b2d9d640 1 -- 172.21.15.29:0/4215344068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b41a6840 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b2d9d640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 0x7f38b40744f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e9f0 tx=0x7f38a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a400cd80 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b41a6b30 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f38a40108e0 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4018920 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.902+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b41a7040 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.903+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b41021c0 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.904+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f38a4010a90 con 0x7f38b4101de0 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.905+0000 7f389bfff640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f389c0a32d0 0x7f389c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.905+0000 7f38b259c640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f389c0a32d0 0x7f389c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.905+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f38a40d0540 con 0x7f38b4101de0 2024-09-19T07:07:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.905+0000 7f38b259c640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f389c0a32d0 0x7f389c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f38a8031440 tx=0x7f38a8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:07.908+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38a409c810 con 0x7f38b4101de0 2024-09-19T07:07:08.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.111+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f38b4062630 con 0x7f389c0a32d0 2024-09-19T07:07:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.116+0000 7f389bfff640 1 -- 172.21.15.29:0/4215344068 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f38b4062630 con 0x7f389c0a32d0 2024-09-19T07:07:08.118 INFO:teuthology.orchestra.run.smithi029.stdout:/volumes/qa/sv_0/46994bc4-d517-4df4-8760-45405c51ecc7 2024-09-19T07:07:08.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f389c0a32d0 msgr2=0x7f389c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f389c0a32d0 0x7f389c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f38a8031440 tx=0x7f38a8005b50 comp rx=0 tx=0).stop 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 msgr2=0x7f38b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 0x7f38b40744f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f38a400e9f0 tx=0x7f38a400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 shutdown_connections 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f38b4106f10 0x7f38b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f389c0a32d0 0x7f389c0a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38b4102790 0x7f38b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 --2- 172.21.15.29:0/4215344068 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38b4101de0 0x7f38b40744f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 >> 172.21.15.29:0/4215344068 conn(0x7f38b40fd8c0 msgr2=0x7f38b40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 shutdown_connections 2024-09-19T07:07:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:08.118+0000 7f38b9104640 1 -- 172.21.15.29:0/4215344068 wait complete. 2024-09-19T07:07:08.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T07:07:09.072 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:09.329 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:09 smithi029 ceph-mon[31255]: pgmap v315: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T07:07:09.329 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:09 smithi029 ceph-mon[31255]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:09.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:09 smithi078 ceph-mon[34556]: pgmap v315: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T07:07:09.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:09 smithi078 ceph-mon[34556]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:09 smithi046 ceph-mon[34147]: pgmap v315: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-19T07:07:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:09 smithi046 ceph-mon[34147]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 -- 172.21.15.29:0/3371238018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 msgr2=0x7f491c10d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 --2- 172.21.15.29:0/3371238018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c10d910 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4914009ca0 tx=0x7f491402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 -- 172.21.15.29:0/3371238018 shutdown_connections 2024-09-19T07:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 --2- 172.21.15.29:0/3371238018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c10d910 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 --2- 172.21.15.29:0/3371238018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f491c101240 0x7f491c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 --2- 172.21.15.29:0/3371238018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f491c105a90 0x7f491c105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 -- 172.21.15.29:0/3371238018 >> 172.21.15.29:0/3371238018 conn(0x7f491c077210 msgr2=0x7f491c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 -- 172.21.15.29:0/3371238018 shutdown_connections 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.553+0000 7f4921f8a640 1 -- 172.21.15.29:0/3371238018 wait complete. 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 Processor -- start 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 -- start start 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f491c101240 0x7f491c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:09.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f491c105a90 0x7f491c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f491c110e20 con 0x7f491c101bc0 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f491c110ca0 con 0x7f491c105a90 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f4921f8a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f491c110fa0 con 0x7f491c101240 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f491affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f491affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44306/0 (socket says 172.21.15.29:44306) 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f491affd640 1 -- 172.21.15.29:0/248098713 learned_addr learned my addr 172.21.15.29:0/248098713 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f491b7fe640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f491c101240 0x7f491c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.554+0000 7f491bfff640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f491c105a90 0x7f491c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f491affd640 1 -- 172.21.15.29:0/248098713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f491c101240 msgr2=0x7f491c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f491affd640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f491c101240 0x7f491c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f491affd640 1 -- 172.21.15.29:0/248098713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f491c105a90 msgr2=0x7f491c19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f491affd640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f491c105a90 0x7f491c19eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f491affd640 1 -- 172.21.15.29:0/248098713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f491c19f580 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f491affd640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c19ab10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f491000d770 tx=0x7f491000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910017070 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f49100054d0 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f491c19f870 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4910004cf0 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.555+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f491c1a7150 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.556+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f491c101680 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.557+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4910004e90 con 0x7f491c101bc0 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.558+0000 7f4918ff9640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f49040a3350 0x7f49040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:09.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.558+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f49100cf6d0 con 0x7f491c101bc0 2024-09-19T07:07:09.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.558+0000 7f491b7fe640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f49040a3350 0x7f49040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:09.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.559+0000 7f491b7fe640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f49040a3350 0x7f49040a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f490c009bd0 tx=0x7f490c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:09.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.562+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f491009c050 con 0x7f491c101bc0 2024-09-19T07:07:09.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.763+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f491c100840 con 0x7f49040a3350 2024-09-19T07:07:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.790+0000 7f4918ff9640 1 -- 172.21.15.29:0/248098713 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f491c100840 con 0x7f49040a3350 2024-09-19T07:07:09.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f49040a3350 msgr2=0x7f49040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f49040a3350 0x7f49040a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f490c009bd0 tx=0x7f490c005f90 comp rx=0 tx=0).stop 2024-09-19T07:07:09.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 msgr2=0x7f491c19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:09.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c19ab10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f491000d770 tx=0x7f491000dc30 comp rx=0 tx=0).stop 2024-09-19T07:07:09.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 shutdown_connections 2024-09-19T07:07:09.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f491c105a90 0x7f491c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f491c101bc0 0x7f491c19ab10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f49040a3350 0x7f49040a5810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 --2- 172.21.15.29:0/248098713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f491c101240 0x7f491c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:09.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 >> 172.21.15.29:0/248098713 conn(0x7f491c077210 msgr2=0x7f491c100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:09.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 shutdown_connections 2024-09-19T07:07:09.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:09.792+0000 7f4921f8a640 1 -- 172.21.15.29:0/248098713 wait complete. 2024-09-19T07:07:10.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:10 smithi029 ceph-mon[31255]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:10.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:10 smithi078 ceph-mon[34556]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:10 smithi046 ceph-mon[34147]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:10.524 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T07:07:10.786 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:11.199 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:11 smithi029 ceph-mon[31255]: pgmap v316: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T07:07:11.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 -- 172.21.15.29:0/712344355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349410c170 msgr2=0x7f349410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:11.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 --2- 172.21.15.29:0/712344355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349410c170 0x7f349410e610 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f348c009ca0 tx=0x7f348c02a950 comp rx=0 tx=0).stop 2024-09-19T07:07:11.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 -- 172.21.15.29:0/712344355 shutdown_connections 2024-09-19T07:07:11.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 --2- 172.21.15.29:0/712344355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f349410c170 0x7f349410e610 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 --2- 172.21.15.29:0/712344355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3494103660 0x7f349410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 --2- 172.21.15.29:0/712344355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3494102d40 0x7f3494103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 -- 172.21.15.29:0/712344355 >> 172.21.15.29:0/712344355 conn(0x7f34940fc7a0 msgr2=0x7f34940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 -- 172.21.15.29:0/712344355 shutdown_connections 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.285+0000 7f349a1bf640 1 -- 172.21.15.29:0/712344355 wait complete. 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 Processor -- start 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 -- start start 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 0x7f34941009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3494103660 0x7f3494100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f349410c170 0x7f3494101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f3494111e50 con 0x7f3494102d40 2024-09-19T07:07:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3494111cd0 con 0x7f3494103660 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f349a1bf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3494111fd0 con 0x7f349410c170 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f34937fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 0x7f34941009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f34937fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 0x7f34941009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44316/0 (socket says 172.21.15.29:44316) 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.286+0000 7f34937fe640 1 -- 172.21.15.29:0/3402367606 learned_addr learned my addr 172.21.15.29:0/3402367606 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f3493fff640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f349410c170 0x7f3494101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f348bfff640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3494103660 0x7f3494100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34937fe640 1 -- 172.21.15.29:0/3402367606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f349410c170 msgr2=0x7f3494101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34937fe640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f349410c170 0x7f3494101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34937fe640 1 -- 172.21.15.29:0/3402367606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3494103660 msgr2=0x7f3494100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34937fe640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3494103660 0x7f3494100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34937fe640 1 -- 172.21.15.29:0/3402367606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34941a6740 con 0x7f3494102d40 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34937fe640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 0x7f34941009a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f348400c920 tx=0x7f348400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484007c70 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3484007e10 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484018820 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34941a6a30 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.287+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941a6fc0 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.288+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3494103120 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.289+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f34840189c0 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.290+0000 7f34917fa640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f34800a3350 0x7f34800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.290+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f34840cfee0 con 0x7f3494102d40 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.290+0000 7f348bfff640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f34800a3350 0x7f34800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.291+0000 7f348bfff640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f34800a3350 0x7f34800a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f347c0058c0 tx=0x7f347c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.294+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3484014030 con 0x7f3494102d40 2024-09-19T07:07:11.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:11 smithi078 ceph-mon[34556]: pgmap v316: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T07:07:11.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:11 smithi046 ceph-mon[34147]: pgmap v316: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T07:07:11.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.497+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f34940fe530 con 0x7f34800a3350 2024-09-19T07:07:11.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.502+0000 7f34917fa640 1 -- 172.21.15.29:0/3402367606 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f34940fe530 con 0x7f34800a3350 2024-09-19T07:07:11.504 INFO:teuthology.orchestra.run.smithi029.stdout:/volumes/qa/sv_1/2c5feda0-222c-45f1-b522-4e2ff31de882 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f34800a3350 msgr2=0x7f34800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f34800a3350 0x7f34800a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f347c0058c0 tx=0x7f347c005850 comp rx=0 tx=0).stop 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 msgr2=0x7f34941009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 0x7f34941009a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f348400c920 tx=0x7f348400cde0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 shutdown_connections 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f34800a3350 0x7f34800a5810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f349410c170 0x7f3494101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3494103660 0x7f3494100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 --2- 172.21.15.29:0/3402367606 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3494102d40 0x7f34941009a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:11.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 >> 172.21.15.29:0/3402367606 conn(0x7f34940fc7a0 msgr2=0x7f34940fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:11.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 shutdown_connections 2024-09-19T07:07:11.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:11.504+0000 7f349a1bf640 1 -- 172.21.15.29:0/3402367606 wait complete. 2024-09-19T07:07:12.189 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:12 smithi029 ceph-mon[31255]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:12.220 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:07:12.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:12 smithi078 ceph-mon[34556]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:12.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:12 smithi046 ceph-mon[34147]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:07:12.478 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 -- 172.21.15.29:0/10556706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 msgr2=0x7fd81010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 --2- 172.21.15.29:0/10556706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd81010ea90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd808009ca0 tx=0x7fd80802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 -- 172.21.15.29:0/10556706 shutdown_connections 2024-09-19T07:07:12.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 --2- 172.21.15.29:0/10556706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd81010ea90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 --2- 172.21.15.29:0/10556706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd810102790 0x7fd8101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 --2- 172.21.15.29:0/10556706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd810101de0 0x7fd8101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 -- 172.21.15.29:0/10556706 >> 172.21.15.29:0/10556706 conn(0x7fd8100fd8c0 msgr2=0x7fd8100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.952+0000 7fd8186ba640 1 -- 172.21.15.29:0/10556706 shutdown_connections 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 -- 172.21.15.29:0/10556706 wait complete. 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 Processor -- start 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 -- start start 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd810101de0 0x7fd8100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd810102790 0x7fd810074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd810074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd810111e40 con 0x7fd810106f10 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd810111cc0 con 0x7fd810102790 2024-09-19T07:07:12.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd8186ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd810111fc0 con 0x7fd810101de0 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd816c57640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd810074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.953+0000 7fd816c57640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd810074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44332/0 (socket says 172.21.15.29:44332) 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 -- 172.21.15.29:0/3661065148 learned_addr learned my addr 172.21.15.29:0/3661065148 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd815c55640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd810102790 0x7fd810074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816456640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd810101de0 0x7fd8100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 -- 172.21.15.29:0/3661065148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd810101de0 msgr2=0x7fd8100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd810101de0 0x7fd8100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 -- 172.21.15.29:0/3661065148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd810102790 msgr2=0x7fd810074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd810102790 0x7fd810074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 -- 172.21.15.29:0/3661065148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8101a68c0 con 0x7fd810106f10 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd816c57640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd810074f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd808009dc0 tx=0x7fd808032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:12.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808003cf0 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd8080044f0 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8101a6b50 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808030b80 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.954+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8101a7090 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.956+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8101021c0 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.957+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd8080046a0 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.958+0000 7fd8077fe640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd7fc0a32d0 0x7fd7fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.958+0000 7fd816456640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd7fc0a32d0 0x7fd7fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.958+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fd8080f1100 con 0x7fd810106f10 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.958+0000 7fd816456640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd7fc0a32d0 0x7fd7fc0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00bbe0 tx=0x7fd80c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:12.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:12.962+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8080bdb90 con 0x7fd810106f10 2024-09-19T07:07:13.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:13 smithi029 ceph-mon[31255]: pgmap v317: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-19T07:07:13.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.190+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd81010a0f0 con 0x7fd810106f10 2024-09-19T07:07:13.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.191+0000 7fd8077fe640 1 -- 172.21.15.29:0/3661065148 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7fd8080bd490 con 0x7fd810106f10 2024-09-19T07:07:13.198 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:13.198 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd7fc0a32d0 msgr2=0x7fd7fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd7fc0a32d0 0x7fd7fc0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00bbe0 tx=0x7fd80c00b390 comp rx=0 tx=0).stop 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 msgr2=0x7fd810074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd810074f70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd808009dc0 tx=0x7fd808032ff0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 shutdown_connections 2024-09-19T07:07:13.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd810106f10 0x7fd810074f70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd810102790 0x7fd810074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd7fc0a32d0 0x7fd7fc0a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 --2- 172.21.15.29:0/3661065148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd810101de0 0x7fd8100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:13.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 >> 172.21.15.29:0/3661065148 conn(0x7fd8100fd8c0 msgr2=0x7fd8100fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:13.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 shutdown_connections 2024-09-19T07:07:13.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:13.193+0000 7fd8186ba640 1 -- 172.21.15.29:0/3661065148 wait complete. 2024-09-19T07:07:13.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:13 smithi078 ceph-mon[34556]: pgmap v317: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-19T07:07:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:13 smithi046 ceph-mon[34147]: pgmap v317: 129 pgs: 129 active+clean; 601 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-19T07:07:13.907 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:07:14.171 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:14.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3661065148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:07:14.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T07:07:14.293 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-19T07:07:14.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T07:07:14.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T07:07:14.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T07:07:14.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T07:07:14.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]: dispatch 2024-09-19T07:07:14.294 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-19T07:07:14.295 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]: dispatch 2024-09-19T07:07:14.295 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-19T07:07:14.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3661065148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]: dispatch 2024-09-19T07:07:14.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-19T07:07:14.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3661065148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:07:14.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T07:07:14.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-09-19T07:07:14.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T07:07:14.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T07:07:14.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T07:07:14.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-19T07:07:14.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]: dispatch 2024-09-19T07:07:14.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-19T07:07:14.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]: dispatch 2024-09-19T07:07:14.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-19T07:07:14.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 -- 172.21.15.29:0/3424106469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 msgr2=0x7fe50410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:14.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 --2- 172.21.15.29:0/3424106469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50410bb50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009900 tx=0x7fe4f802a480 comp rx=0 tx=0).stop 2024-09-19T07:07:14.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 -- 172.21.15.29:0/3424106469 shutdown_connections 2024-09-19T07:07:14.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 --2- 172.21.15.29:0/3424106469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe50410c170 0x7fe50410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 --2- 172.21.15.29:0/3424106469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50410bb50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 --2- 172.21.15.29:0/3424106469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe504102d40 0x7fe504103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 -- 172.21.15.29:0/3424106469 >> 172.21.15.29:0/3424106469 conn(0x7fe5040fc7a0 msgr2=0x7fe5040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 -- 172.21.15.29:0/3424106469 shutdown_connections 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.677+0000 7fe50c042640 1 -- 172.21.15.29:0/3424106469 wait complete. 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 Processor -- start 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 -- start start 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe504102d40 0x7fe50419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50410c170 0x7fe50419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe5041017d0 con 0x7fe504103660 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe504101650 con 0x7fe504102d40 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50c042640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe504101950 con 0x7fe50410c170 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:14.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44362/0 (socket says 172.21.15.29:44362) 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 -- 172.21.15.29:0/1538502955 learned_addr learned my addr 172.21.15.29:0/1538502955 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe509dde640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe504102d40 0x7fe50419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe50a5df640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50410c170 0x7fe50419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 -- 172.21.15.29:0/1538502955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50410c170 msgr2=0x7fe50419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50410c170 0x7fe50419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 -- 172.21.15.29:0/1538502955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe504102d40 msgr2=0x7fe50419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.678+0000 7fe5095dd640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe504102d40 0x7fe50419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe5095dd640 1 -- 172.21.15.29:0/1538502955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50419f520 con 0x7fe504103660 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe5095dd640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50419aab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8005ab0 tx=0x7fe4f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f803f070 con 0x7fe504103660 2024-09-19T07:07:14.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe4f8031b60 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50419f7b0 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8035030 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.679+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5041a70f0 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.680+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50406b070 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.681+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe4f8042070 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.682+0000 7fe4f6ffd640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe4f00a32d0 0x7fe4f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.682+0000 7fe509dde640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe4f00a32d0 0x7fe4f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.682+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe4f80f04b0 con 0x7fe504103660 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.682+0000 7fe509dde640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe4f00a32d0 0x7fe4f00a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe500009bd0 tx=0x7fe500005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:14.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.686+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4f80bc660 con 0x7fe504103660 2024-09-19T07:07:14.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.863+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5041061e0 con 0x7fe504103660 2024-09-19T07:07:14.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.865+0000 7fe4f6ffd640 1 -- 172.21.15.29:0/1538502955 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24654 (secure 0 0 0) 0x7fe4f80c0960 con 0x7fe504103660 2024-09-19T07:07:14.867 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:14.867 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":89,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:07:14.048779+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:07:14.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe4f00a32d0 msgr2=0x7fe4f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:14.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe4f00a32d0 0x7fe4f00a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe500009bd0 tx=0x7fe500005f90 comp rx=0 tx=0).stop 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 msgr2=0x7fe50419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50419aab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8005ab0 tx=0x7fe4f8003c10 comp rx=0 tx=0).stop 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 shutdown_connections 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe4f00a32d0 0x7fe4f00a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe50410c170 0x7fe50419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe504103660 0x7fe50419aab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 --2- 172.21.15.29:0/1538502955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe504102d40 0x7fe50419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 >> 172.21.15.29:0/1538502955 conn(0x7fe5040fc7a0 msgr2=0x7fe50410d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 shutdown_connections 2024-09-19T07:07:14.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:14.867+0000 7fe50c042640 1 -- 172.21.15.29:0/1538502955 wait complete. 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: pgmap v318: 129 pgs: 129 active+clean; 625 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T07:07:15.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]': finished 2024-09-19T07:07:15.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-19T07:07:15.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]': finished 2024-09-19T07:07:15.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-19T07:07:15.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:07:15.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:15 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1538502955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: pgmap v318: 129 pgs: 129 active+clean; 625 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]': finished 2024-09-19T07:07:15.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-19T07:07:15.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:07:15.447 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:15 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1538502955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: pgmap v318: 129 pgs: 129 active+clean; 625 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T07:07:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-19T07:07:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [5, 8]}]': finished 2024-09-19T07:07:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-19T07:07:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 10]}]': finished 2024-09-19T07:07:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-19T07:07:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:07:15.476 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:15 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1538502955' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:15.582 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:07:15.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:07:15.841 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:16.237 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:16 smithi029 ceph-mon[31255]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 -- 172.21.15.29:0/387403150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 msgr2=0x7f2b88110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/387403150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b88110810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009900 tx=0x7f2b8002a480 comp rx=0 tx=0).stop 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 -- 172.21.15.29:0/387403150 shutdown_connections 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/387403150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b88110810 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/387403150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88074f40 0x7f2b8810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/387403150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88074620 0x7f2b88074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 -- 172.21.15.29:0/387403150 >> 172.21.15.29:0/387403150 conn(0x7f2b880fd8c0 msgr2=0x7f2b880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 -- 172.21.15.29:0/387403150 shutdown_connections 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 -- 172.21.15.29:0/387403150 wait complete. 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 Processor -- start 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.319+0000 7f2b8f62d640 1 -- start start 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8f62d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88074620 0x7f2b8819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8f62d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88074f40 0x7f2b8819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8f62d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b8819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8f62d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88114070 con 0x7f2b8810e3c0 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8f62d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88113ef0 con 0x7f2b88074620 2024-09-19T07:07:16.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8f62d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881141f0 con 0x7f2b88074f40 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b8819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b8819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52654/0 (socket says 172.21.15.29:52654) 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 -- 172.21.15.29:0/2848499659 learned_addr learned my addr 172.21.15.29:0/2848499659 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8d3c9640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88074620 0x7f2b8819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8cbc8640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88074f40 0x7f2b8819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 -- 172.21.15.29:0/2848499659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88074f40 msgr2=0x7f2b8819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88074f40 0x7f2b8819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 -- 172.21.15.29:0/2848499659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88074620 msgr2=0x7f2b8819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88074620 0x7f2b8819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 -- 172.21.15.29:0/2848499659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8819f5a0 con 0x7f2b8810e3c0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b8dbca640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b8819eec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b8002a9a0 tx=0x7f2b80003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.320+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8003f070 con 0x7f2b8810e3c0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.321+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b80031d60 con 0x7f2b8810e3c0 2024-09-19T07:07:16.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.321+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8819f830 con 0x7f2b8810e3c0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.321+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80035030 con 0x7f2b8810e3c0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.321+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b881a7170 con 0x7f2b8810e3c0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.321+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b88074a00 con 0x7f2b8810e3c0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.323+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b80042070 con 0x7f2b8810e3c0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.324+0000 7f2b867fc640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2b700a32d0 0x7f2b700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.324+0000 7f2b8d3c9640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2b700a32d0 0x7f2b700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.324+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f2b800f0cf0 con 0x7f2b8810e3c0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.324+0000 7f2b8d3c9640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2b700a32d0 0x7f2b700a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b78005fd0 tx=0x7f2b78009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:16.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.327+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b800bd550 con 0x7f2b8810e3c0 2024-09-19T07:07:16.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:16 smithi078 ceph-mon[34556]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:07:16.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:16 smithi046 ceph-mon[34147]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:07:16.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.504+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b881095a0 con 0x7f2b700a32d0 2024-09-19T07:07:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.514+0000 7f2b867fc640 1 -- 172.21.15.29:0/2848499659 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340251 (secure 0 0 0) 0x7f2b881095a0 con 0x7f2b700a32d0 2024-09-19T07:07:16.520 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:07:16.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.518+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2b700a32d0 msgr2=0x7f2b700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:16.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.518+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2b700a32d0 0x7f2b700a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b78005fd0 tx=0x7f2b78009760 comp rx=0 tx=0).stop 2024-09-19T07:07:16.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 msgr2=0x7f2b8819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:16.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b8819eec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b8002a9a0 tx=0x7f2b80003cd0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 shutdown_connections 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b8810e3c0 0x7f2b8819eec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2b700a32d0 0x7f2b700a5790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b88074f40 0x7f2b8819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 --2- 172.21.15.29:0/2848499659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88074620 0x7f2b8819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 >> 172.21.15.29:0/2848499659 conn(0x7f2b880fd8c0 msgr2=0x7f2b880fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 shutdown_connections 2024-09-19T07:07:16.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:16.519+0000 7f2b8f62d640 1 -- 172.21.15.29:0/2848499659 wait complete. 2024-09-19T07:07:17.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:17 smithi029 ceph-mon[31255]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 625 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-09-19T07:07:17.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:17 smithi029 ceph-mon[31255]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:17.239 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-19T07:07:15.854169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640498,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":178,"num_write":254,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":400292,"kb_used_data":13580,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124541532,"statfs":{"total":1151940427776,"available":1151530528768,"internally_reserved":0,"allocated":13905920,"data_stored":7799896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":395752764},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24752,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":30,"num_write":14,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002047"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.822465+0000","last_change":"2024-09-19T07:06:22.660137+0000","last_active":"2024-09-19T07:06:34.822465+0000","last_peered":"2024-09-19T07:06:34.822465+0000","last_clean":"2024-09-19T07:06:34.822465+0000","last_became_active":"2024-09-19T07:06:22.659861+0000","last_became_peered":"2024-09-19T07:06:22.659861+0000","last_unstale":"2024-09-19T07:06:34.822465+0000","last_undegraded":"2024-09-19T07:06:34.822465+0000","last_fullsized":"2024-09-19T07:06:34.822465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:14.034137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394069+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:06:35.394069+0000","last_peered":"2024-09-19T07:06:35.394069+0000","last_clean":"2024-09-19T07:06:35.394069+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:06:35.394069+0000","last_undegraded":"2024-09-19T07:06:35.394069+0000","last_fullsized":"2024-09-19T07:06:35.394069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394670+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:06:35.394670+0000","last_peered":"2024-09-19T07:06:35.394670+0000","last_clean":"2024-09-19T07:06:35.394670+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:06:35.394670+0000","last_undegraded":"2024-09-19T07:06:35.394670+0000","last_fullsized":"2024-09-19T07:06:35.394670+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062329+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:14.062329+0000","last_peered":"2024-09-19T07:07:14.062329+0000","last_clean":"2024-09-19T07:07:14.062329+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:14.062329+0000","last_undegraded":"2024-09-19T07:07:14.062329+0000","last_fullsized":"2024-09-19T07:07:14.062329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393225+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:06:35.393225+0000","last_peered":"2024-09-19T07:06:35.393225+0000","last_clean":"2024-09-19T07:06:35.393225+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:06:35.393225+0000","last_undegraded":"2024-09-19T07:06:35.393225+0000","last_fullsized":"2024-09-19T07:06:35.393225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394371+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:06:35.394371+0000","last_peered":"2024-09-19T07:06:35.394371+0000","last_clean":"2024-09-19T07:06:35.394371+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:06:35.394371+0000","last_undegraded":"2024-09-19T07:06:35.394371+0000","last_fullsized":"2024-09-19T07:06:35.394371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062028+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:14.062028+0000","last_peered":"2024-09-19T07:07:14.062028+0000","last_clean":"2024-09-19T07:07:14.062028+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:14.062028+0000","last_undegraded":"2024-09-19T07:07:14.062028+0000","last_fullsized":"2024-09-19T07:07:14.062028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393864+0000","last_change":"2024-09-19T07:06:31.838573+0000","last_active":"2024-09-19T07:06:35.393864+0000","last_peered":"2024-09-19T07:06:35.393864+0000","last_clean":"2024-09-19T07:06:35.393864+0000","last_became_active":"2024-09-19T07:06:31.837894+0000","last_became_peered":"2024-09-19T07:06:31.837894+0000","last_unstale":"2024-09-19T07:06:35.393864+0000","last_undegraded":"2024-09-19T07:06:35.393864+0000","last_fullsized":"2024-09-19T07:06:35.393864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:23.155205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394185+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:06:35.394185+0000","last_peered":"2024-09-19T07:06:35.394185+0000","last_clean":"2024-09-19T07:06:35.394185+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:06:35.394185+0000","last_undegraded":"2024-09-19T07:06:35.394185+0000","last_fullsized":"2024-09-19T07:06:35.394185+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063450+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:14.063450+0000","last_peered":"2024-09-19T07:07:14.063450+0000","last_clean":"2024-09-19T07:07:14.063450+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:14.063450+0000","last_undegraded":"2024-09-19T07:07:14.063450+0000","last_fullsized":"2024-09-19T07:07:14.063450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393550+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:06:35.393550+0000","last_peered":"2024-09-19T07:06:35.393550+0000","last_clean":"2024-09-19T07:06:35.393550+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:06:35.393550+0000","last_undegraded":"2024-09-19T07:06:35.393550+0000","last_fullsized":"2024-09-19T07:06:35.393550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393763+0000","last_change":"2024-09-19T07:06:22.667893+0000","last_active":"2024-09-19T07:06:35.393763+0000","last_peered":"2024-09-19T07:06:35.393763+0000","last_clean":"2024-09-19T07:06:35.393763+0000","last_became_active":"2024-09-19T07:06:22.667537+0000","last_became_peered":"2024-09-19T07:06:22.667537+0000","last_unstale":"2024-09-19T07:06:35.393763+0000","last_undegraded":"2024-09-19T07:06:35.393763+0000","last_fullsized":"2024-09-19T07:06:35.393763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:04.219225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394321+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:06:35.394321+0000","last_peered":"2024-09-19T07:06:35.394321+0000","last_clean":"2024-09-19T07:06:35.394321+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:06:35.394321+0000","last_undegraded":"2024-09-19T07:06:35.394321+0000","last_fullsized":"2024-09-19T07:06:35.394321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394648+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:06:35.394648+0000","last_peered":"2024-09-19T07:06:35.394648+0000","last_clean":"2024-09-19T07:06:35.394648+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:06:35.394648+0000","last_undegraded":"2024-09-19T07:06:35.394648+0000","last_fullsized":"2024-09-19T07:06:35.394648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.148123+0000","last_change":"2024-09-19T07:06:22.663481+0000","last_active":"2024-09-19T07:06:35.148123+0000","last_peered":"2024-09-19T07:06:35.148123+0000","last_clean":"2024-09-19T07:06:35.148123+0000","last_became_active":"2024-09-19T07:06:22.662746+0000","last_became_peered":"2024-09-19T07:06:22.662746+0000","last_unstale":"2024-09-19T07:06:35.148123+0000","last_undegraded":"2024-09-19T07:06:35.148123+0000","last_fullsized":"2024-09-19T07:06:35.148123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:57.956780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393852+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:06:35.393852+0000","last_peered":"2024-09-19T07:06:35.393852+0000","last_clean":"2024-09-19T07:06:35.393852+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:06:35.393852+0000","last_undegraded":"2024-09-19T07:06:35.393852+0000","last_fullsized":"2024-09-19T07:06:35.393852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828500+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:06:34.828500+0000","last_peered":"2024-09-19T07:06:34.828500+0000","last_clean":"2024-09-19T07:06:34.828500+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:06:34.828500+0000","last_undegraded":"2024-09-19T07:06:34.828500+0000","last_fullsized":"2024-09-19T07:06:34.828500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394532+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:06:35.394532+0000","last_peered":"2024-09-19T07:06:35.394532+0000","last_clean":"2024-09-19T07:06:35.394532+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:06:35.394532+0000","last_undegraded":"2024-09-19T07:06:35.394532+0000","last_fullsized":"2024-09-19T07:06:35.394532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.822251+0000","last_change":"2024-09-19T07:06:31.834981+0000","last_active":"2024-09-19T07:06:34.822251+0000","last_peered":"2024-09-19T07:06:34.822251+0000","last_clean":"2024-09-19T07:06:34.822251+0000","last_became_active":"2024-09-19T07:06:31.834504+0000","last_became_peered":"2024-09-19T07:06:31.834504+0000","last_unstale":"2024-09-19T07:06:34.822251+0000","last_undegraded":"2024-09-19T07:06:34.822251+0000","last_fullsized":"2024-09-19T07:06:34.822251+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:46.148257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393348+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:06:35.393348+0000","last_peered":"2024-09-19T07:06:35.393348+0000","last_clean":"2024-09-19T07:06:35.393348+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:06:35.393348+0000","last_undegraded":"2024-09-19T07:06:35.393348+0000","last_fullsized":"2024-09-19T07:06:35.393348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061498+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:14.061498+0000","last_peered":"2024-09-19T07:07:14.061498+0000","last_clean":"2024-09-19T07:07:14.061498+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:14.061498+0000","last_undegraded":"2024-09-19T07:07:14.061498+0000","last_fullsized":"2024-09-19T07:07:14.061498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394111+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:06:35.394111+0000","last_peered":"2024-09-19T07:06:35.394111+0000","last_clean":"2024-09-19T07:06:35.394111+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:06:35.394111+0000","last_undegraded":"2024-09-19T07:06:35.394111+0000","last_fullsized":"2024-09-19T07:06:35.394111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062369+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:14.062369+0000","last_peered":"2024-09-19T07:07:14.062369+0000","last_clean":"2024-09-19T07:07:14.062369+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:14.062369+0000","last_undegraded":"2024-09-19T07:07:14.062369+0000","last_fullsized":"2024-09-19T07:07:14.062369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394249+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:06:35.394249+0000","last_peered":"2024-09-19T07:06:35.394249+0000","last_clean":"2024-09-19T07:06:35.394249+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:06:35.394249+0000","last_undegraded":"2024-09-19T07:06:35.394249+0000","last_fullsized":"2024-09-19T07:06:35.394249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394418+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:06:35.394418+0000","last_peered":"2024-09-19T07:06:35.394418+0000","last_clean":"2024-09-19T07:06:35.394418+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:06:35.394418+0000","last_undegraded":"2024-09-19T07:06:35.394418+0000","last_fullsized":"2024-09-19T07:06:35.394418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'5","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:07:09.810813+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:09.810813+0000","last_peered":"2024-09-19T07:07:09.810813+0000","last_clean":"2024-09-19T07:07:09.810813+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:09.810813+0000","last_undegraded":"2024-09-19T07:07:09.810813+0000","last_fullsized":"2024-09-19T07:07:09.810813+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393705+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:06:35.393705+0000","last_peered":"2024-09-19T07:06:35.393705+0000","last_clean":"2024-09-19T07:06:35.393705+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:06:35.393705+0000","last_undegraded":"2024-09-19T07:06:35.393705+0000","last_fullsized":"2024-09-19T07:06:35.393705+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064844+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:14.064844+0000","last_peered":"2024-09-19T07:07:14.064844+0000","last_clean":"2024-09-19T07:07:14.064844+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:14.064844+0000","last_undegraded":"2024-09-19T07:07:14.064844+0000","last_fullsized":"2024-09-19T07:07:14.064844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394396+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:06:35.394396+0000","last_peered":"2024-09-19T07:06:35.394396+0000","last_clean":"2024-09-19T07:06:35.394396+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:06:35.394396+0000","last_undegraded":"2024-09-19T07:06:35.394396+0000","last_fullsized":"2024-09-19T07:06:35.394396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828671+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:06:34.828671+0000","last_peered":"2024-09-19T07:06:34.828671+0000","last_clean":"2024-09-19T07:06:34.828671+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:06:34.828671+0000","last_undegraded":"2024-09-19T07:06:34.828671+0000","last_fullsized":"2024-09-19T07:06:34.828671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.321998+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:06:35.321998+0000","last_peered":"2024-09-19T07:06:35.321998+0000","last_clean":"2024-09-19T07:06:35.321998+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:06:35.321998+0000","last_undegraded":"2024-09-19T07:06:35.321998+0000","last_fullsized":"2024-09-19T07:06:35.321998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.822272+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:06:34.822272+0000","last_peered":"2024-09-19T07:06:34.822272+0000","last_clean":"2024-09-19T07:06:34.822272+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:06:34.822272+0000","last_undegraded":"2024-09-19T07:06:34.822272+0000","last_fullsized":"2024-09-19T07:06:34.822272+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393437+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:06:35.393437+0000","last_peered":"2024-09-19T07:06:35.393437+0000","last_clean":"2024-09-19T07:06:35.393437+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:06:35.393437+0000","last_undegraded":"2024-09-19T07:06:35.393437+0000","last_fullsized":"2024-09-19T07:06:35.393437+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.321922+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:06:35.321922+0000","last_peered":"2024-09-19T07:06:35.321922+0000","last_clean":"2024-09-19T07:06:35.321922+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:06:35.321922+0000","last_undegraded":"2024-09-19T07:06:35.321922+0000","last_fullsized":"2024-09-19T07:06:35.321922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064749+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:14.064749+0000","last_peered":"2024-09-19T07:07:14.064749+0000","last_clean":"2024-09-19T07:07:14.064749+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:14.064749+0000","last_undegraded":"2024-09-19T07:07:14.064749+0000","last_fullsized":"2024-09-19T07:07:14.064749+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063853+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:14.063853+0000","last_peered":"2024-09-19T07:07:14.063853+0000","last_clean":"2024-09-19T07:07:14.063853+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:14.063853+0000","last_undegraded":"2024-09-19T07:07:14.063853+0000","last_fullsized":"2024-09-19T07:07:14.063853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064207+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:14.064207+0000","last_peered":"2024-09-19T07:07:14.064207+0000","last_clean":"2024-09-19T07:07:14.064207+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:14.064207+0000","last_undegraded":"2024-09-19T07:07:14.064207+0000","last_fullsized":"2024-09-19T07:07:14.064207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.065046+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:14.065046+0000","last_peered":"2024-09-19T07:07:14.065046+0000","last_clean":"2024-09-19T07:07:14.065046+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:14.065046+0000","last_undegraded":"2024-09-19T07:07:14.065046+0000","last_fullsized":"2024-09-19T07:07:14.065046+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064090+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:14.064090+0000","last_peered":"2024-09-19T07:07:14.064090+0000","last_clean":"2024-09-19T07:07:14.064090+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:14.064090+0000","last_undegraded":"2024-09-19T07:07:14.064090+0000","last_fullsized":"2024-09-19T07:07:14.064090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063558+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:14.063558+0000","last_peered":"2024-09-19T07:07:14.063558+0000","last_clean":"2024-09-19T07:07:14.063558+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:14.063558+0000","last_undegraded":"2024-09-19T07:07:14.063558+0000","last_fullsized":"2024-09-19T07:07:14.063558+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394269+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:06:35.394269+0000","last_peered":"2024-09-19T07:06:35.394269+0000","last_clean":"2024-09-19T07:06:35.394269+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:06:35.394269+0000","last_undegraded":"2024-09-19T07:06:35.394269+0000","last_fullsized":"2024-09-19T07:06:35.394269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394113+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:06:35.394113+0000","last_peered":"2024-09-19T07:06:35.394113+0000","last_clean":"2024-09-19T07:06:35.394113+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:06:35.394113+0000","last_undegraded":"2024-09-19T07:06:35.394113+0000","last_fullsized":"2024-09-19T07:06:35.394113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057575+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057575+0000","last_peered":"2024-09-19T07:07:15.057575+0000","last_clean":"2024-09-19T07:07:15.057575+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057575+0000","last_undegraded":"2024-09-19T07:07:15.057575+0000","last_fullsized":"2024-09-19T07:07:15.057575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061584+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:14.061584+0000","last_peered":"2024-09-19T07:07:14.061584+0000","last_clean":"2024-09-19T07:07:14.061584+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:14.061584+0000","last_undegraded":"2024-09-19T07:07:14.061584+0000","last_fullsized":"2024-09-19T07:07:14.061584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063775+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:14.063775+0000","last_peered":"2024-09-19T07:07:14.063775+0000","last_clean":"2024-09-19T07:07:14.063775+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:14.063775+0000","last_undegraded":"2024-09-19T07:07:14.063775+0000","last_fullsized":"2024-09-19T07:07:14.063775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061633+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:14.061633+0000","last_peered":"2024-09-19T07:07:14.061633+0000","last_clean":"2024-09-19T07:07:14.061633+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:14.061633+0000","last_undegraded":"2024-09-19T07:07:14.061633+0000","last_fullsized":"2024-09-19T07:07:14.061633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":33,"reported_epoch":88,"state":"peering","last_fresh":"2024-09-19T07:06:35.394458+0000","last_change":"2024-09-19T07:07:14.064624+0000","last_active":"2024-09-19T07:07:14.064624+0000","last_peered":"2024-09-19T07:06:35.394458+0000","last_clean":"2024-09-19T07:06:35.394458+0000","last_became_active":"2024-09-19T07:06:22.667893+0000","last_became_peered":"2024-09-19T07:06:22.667893+0000","last_unstale":"2024-09-19T07:06:35.394458+0000","last_undegraded":"2024-09-19T07:06:35.394458+0000","last_fullsized":"2024-09-19T07:06:35.394458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063579+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:14.063579+0000","last_peered":"2024-09-19T07:07:14.063579+0000","last_clean":"2024-09-19T07:07:14.063579+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:14.063579+0000","last_undegraded":"2024-09-19T07:07:14.063579+0000","last_fullsized":"2024-09-19T07:07:14.063579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828780+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:06:34.828780+0000","last_peered":"2024-09-19T07:06:34.828780+0000","last_clean":"2024-09-19T07:06:34.828780+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:06:34.828780+0000","last_undegraded":"2024-09-19T07:06:34.828780+0000","last_fullsized":"2024-09-19T07:06:34.828780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394105+0000","last_change":"2024-09-19T07:06:22.663928+0000","last_active":"2024-09-19T07:06:35.394105+0000","last_peered":"2024-09-19T07:06:35.394105+0000","last_clean":"2024-09-19T07:06:35.394105+0000","last_became_active":"2024-09-19T07:06:22.663626+0000","last_became_peered":"2024-09-19T07:06:22.663626+0000","last_unstale":"2024-09-19T07:06:35.394105+0000","last_undegraded":"2024-09-19T07:06:35.394105+0000","last_fullsized":"2024-09-19T07:06:35.394105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:06.258825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062945+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:14.062945+0000","last_peered":"2024-09-19T07:07:14.062945+0000","last_clean":"2024-09-19T07:07:14.062945+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:14.062945+0000","last_undegraded":"2024-09-19T07:07:14.062945+0000","last_fullsized":"2024-09-19T07:07:14.062945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063200+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:14.063200+0000","last_peered":"2024-09-19T07:07:14.063200+0000","last_clean":"2024-09-19T07:07:14.063200+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:14.063200+0000","last_undegraded":"2024-09-19T07:07:14.063200+0000","last_fullsized":"2024-09-19T07:07:14.063200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393351+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:06:35.393351+0000","last_peered":"2024-09-19T07:06:35.393351+0000","last_clean":"2024-09-19T07:06:35.393351+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:06:35.393351+0000","last_undegraded":"2024-09-19T07:06:35.393351+0000","last_fullsized":"2024-09-19T07:06:35.393351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.065037+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:14.065037+0000","last_peered":"2024-09-19T07:07:14.065037+0000","last_clean":"2024-09-19T07:07:14.065037+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:14.065037+0000","last_undegraded":"2024-09-19T07:07:14.065037+0000","last_fullsized":"2024-09-19T07:07:14.065037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393849+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:06:35.393849+0000","last_peered":"2024-09-19T07:06:35.393849+0000","last_clean":"2024-09-19T07:06:35.393849+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:06:35.393849+0000","last_undegraded":"2024-09-19T07:06:35.393849+0000","last_fullsized":"2024-09-19T07:06:35.393849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.822298+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:06:34.822298+0000","last_peered":"2024-09-19T07:06:34.822298+0000","last_clean":"2024-09-19T07:06:34.822298+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:06:34.822298+0000","last_undegraded":"2024-09-19T07:06:34.822298+0000","last_fullsized":"2024-09-19T07:06:34.822298+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063096+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:14.063096+0000","last_peered":"2024-09-19T07:07:14.063096+0000","last_clean":"2024-09-19T07:07:14.063096+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:14.063096+0000","last_undegraded":"2024-09-19T07:07:14.063096+0000","last_fullsized":"2024-09-19T07:07:14.063096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828766+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:06:34.828766+0000","last_peered":"2024-09-19T07:06:34.828766+0000","last_clean":"2024-09-19T07:06:34.828766+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:06:34.828766+0000","last_undegraded":"2024-09-19T07:06:34.828766+0000","last_fullsized":"2024-09-19T07:06:34.828766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064453+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:14.064453+0000","last_peered":"2024-09-19T07:07:14.064453+0000","last_clean":"2024-09-19T07:07:14.064453+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:14.064453+0000","last_undegraded":"2024-09-19T07:07:14.064453+0000","last_fullsized":"2024-09-19T07:07:14.064453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063795+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:14.063795+0000","last_peered":"2024-09-19T07:07:14.063795+0000","last_clean":"2024-09-19T07:07:14.063795+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:14.063795+0000","last_undegraded":"2024-09-19T07:07:14.063795+0000","last_fullsized":"2024-09-19T07:07:14.063795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394269+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:06:35.394269+0000","last_peered":"2024-09-19T07:06:35.394269+0000","last_clean":"2024-09-19T07:06:35.394269+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:06:35.394269+0000","last_undegraded":"2024-09-19T07:06:35.394269+0000","last_fullsized":"2024-09-19T07:06:35.394269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'24","reported_seq":84,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:07:12.035775+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:07:12.035775+0000","last_peered":"2024-09-19T07:07:12.035775+0000","last_clean":"2024-09-19T07:07:12.035775+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:07:12.035775+0000","last_undegraded":"2024-09-19T07:07:12.035775+0000","last_fullsized":"2024-09-19T07:07:12.035775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":24,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.821936+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:06:34.821936+0000","last_peered":"2024-09-19T07:06:34.821936+0000","last_clean":"2024-09-19T07:06:34.821936+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:06:34.821936+0000","last_undegraded":"2024-09-19T07:06:34.821936+0000","last_fullsized":"2024-09-19T07:06:34.821936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062136+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:14.062136+0000","last_peered":"2024-09-19T07:07:14.062136+0000","last_clean":"2024-09-19T07:07:14.062136+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:14.062136+0000","last_undegraded":"2024-09-19T07:07:14.062136+0000","last_fullsized":"2024-09-19T07:07:14.062136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063662+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:14.063662+0000","last_peered":"2024-09-19T07:07:14.063662+0000","last_clean":"2024-09-19T07:07:14.063662+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:14.063662+0000","last_undegraded":"2024-09-19T07:07:14.063662+0000","last_fullsized":"2024-09-19T07:07:14.063662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393682+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:06:35.393682+0000","last_peered":"2024-09-19T07:06:35.393682+0000","last_clean":"2024-09-19T07:06:35.393682+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:06:35.393682+0000","last_undegraded":"2024-09-19T07:06:35.393682+0000","last_fullsized":"2024-09-19T07:06:35.393682+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062424+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:14.062424+0000","last_peered":"2024-09-19T07:07:14.062424+0000","last_clean":"2024-09-19T07:07:14.062424+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:14.062424+0000","last_undegraded":"2024-09-19T07:07:14.062424+0000","last_fullsized":"2024-09-19T07:07:14.062424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.821756+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:06:34.821756+0000","last_peered":"2024-09-19T07:06:34.821756+0000","last_clean":"2024-09-19T07:06:34.821756+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:06:34.821756+0000","last_undegraded":"2024-09-19T07:06:34.821756+0000","last_fullsized":"2024-09-19T07:06:34.821756+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062096+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:14.062096+0000","last_peered":"2024-09-19T07:07:14.062096+0000","last_clean":"2024-09-19T07:07:14.062096+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:14.062096+0000","last_undegraded":"2024-09-19T07:07:14.062096+0000","last_fullsized":"2024-09-19T07:07:14.062096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.322208+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:06:35.322208+0000","last_peered":"2024-09-19T07:06:35.322208+0000","last_clean":"2024-09-19T07:06:35.322208+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:06:35.322208+0000","last_undegraded":"2024-09-19T07:06:35.322208+0000","last_fullsized":"2024-09-19T07:06:35.322208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394269+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:06:35.394269+0000","last_peered":"2024-09-19T07:06:35.394269+0000","last_clean":"2024-09-19T07:06:35.394269+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:06:35.394269+0000","last_undegraded":"2024-09-19T07:06:35.394269+0000","last_fullsized":"2024-09-19T07:06:35.394269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062102+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:14.062102+0000","last_peered":"2024-09-19T07:07:14.062102+0000","last_clean":"2024-09-19T07:07:14.062102+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:14.062102+0000","last_undegraded":"2024-09-19T07:07:14.062102+0000","last_fullsized":"2024-09-19T07:07:14.062102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.821824+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:06:34.821824+0000","last_peered":"2024-09-19T07:06:34.821824+0000","last_clean":"2024-09-19T07:06:34.821824+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:06:34.821824+0000","last_undegraded":"2024-09-19T07:06:34.821824+0000","last_fullsized":"2024-09-19T07:06:34.821824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064022+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:14.064022+0000","last_peered":"2024-09-19T07:07:14.064022+0000","last_clean":"2024-09-19T07:07:14.064022+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:14.064022+0000","last_undegraded":"2024-09-19T07:07:14.064022+0000","last_fullsized":"2024-09-19T07:07:14.064022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828894+0000","last_change":"2024-09-19T07:06:31.834092+0000","last_active":"2024-09-19T07:06:34.828894+0000","last_peered":"2024-09-19T07:06:34.828894+0000","last_clean":"2024-09-19T07:06:34.828894+0000","last_became_active":"2024-09-19T07:06:31.833617+0000","last_became_peered":"2024-09-19T07:06:31.833617+0000","last_unstale":"2024-09-19T07:06:34.828894+0000","last_undegraded":"2024-09-19T07:06:34.828894+0000","last_fullsized":"2024-09-19T07:06:34.828894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:50.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394269+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:06:35.394269+0000","last_peered":"2024-09-19T07:06:35.394269+0000","last_clean":"2024-09-19T07:06:35.394269+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:06:35.394269+0000","last_undegraded":"2024-09-19T07:06:35.394269+0000","last_fullsized":"2024-09-19T07:06:35.394269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064206+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:14.064206+0000","last_peered":"2024-09-19T07:07:14.064206+0000","last_clean":"2024-09-19T07:07:14.064206+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:14.064206+0000","last_undegraded":"2024-09-19T07:07:14.064206+0000","last_fullsized":"2024-09-19T07:07:14.064206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.321901+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:06:35.321901+0000","last_peered":"2024-09-19T07:06:35.321901+0000","last_clean":"2024-09-19T07:06:35.321901+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:06:35.321901+0000","last_undegraded":"2024-09-19T07:06:35.321901+0000","last_fullsized":"2024-09-19T07:06:35.321901+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062773+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:14.062773+0000","last_peered":"2024-09-19T07:07:14.062773+0000","last_clean":"2024-09-19T07:07:14.062773+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:14.062773+0000","last_undegraded":"2024-09-19T07:07:14.062773+0000","last_fullsized":"2024-09-19T07:07:14.062773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062934+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:14.062934+0000","last_peered":"2024-09-19T07:07:14.062934+0000","last_clean":"2024-09-19T07:07:14.062934+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:14.062934+0000","last_undegraded":"2024-09-19T07:07:14.062934+0000","last_fullsized":"2024-09-19T07:07:14.062934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393453+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:06:35.393453+0000","last_peered":"2024-09-19T07:06:35.393453+0000","last_clean":"2024-09-19T07:06:35.393453+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:06:35.393453+0000","last_undegraded":"2024-09-19T07:06:35.393453+0000","last_fullsized":"2024-09-19T07:06:35.393453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828407+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:06:34.828407+0000","last_peered":"2024-09-19T07:06:34.828407+0000","last_clean":"2024-09-19T07:06:34.828407+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:06:34.828407+0000","last_undegraded":"2024-09-19T07:06:34.828407+0000","last_fullsized":"2024-09-19T07:06:34.828407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061720+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:14.061720+0000","last_peered":"2024-09-19T07:07:14.061720+0000","last_clean":"2024-09-19T07:07:14.061720+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:14.061720+0000","last_undegraded":"2024-09-19T07:07:14.061720+0000","last_fullsized":"2024-09-19T07:07:14.061720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064824+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:14.064824+0000","last_peered":"2024-09-19T07:07:14.064824+0000","last_clean":"2024-09-19T07:07:14.064824+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:14.064824+0000","last_undegraded":"2024-09-19T07:07:14.064824+0000","last_fullsized":"2024-09-19T07:07:14.064824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828940+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:06:34.828940+0000","last_peered":"2024-09-19T07:06:34.828940+0000","last_clean":"2024-09-19T07:06:34.828940+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:06:34.828940+0000","last_undegraded":"2024-09-19T07:06:34.828940+0000","last_fullsized":"2024-09-19T07:06:34.828940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394291+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:06:35.394291+0000","last_peered":"2024-09-19T07:06:35.394291+0000","last_clean":"2024-09-19T07:06:35.394291+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:06:35.394291+0000","last_undegraded":"2024-09-19T07:06:35.394291+0000","last_fullsized":"2024-09-19T07:06:35.394291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063794+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:14.063794+0000","last_peered":"2024-09-19T07:07:14.063794+0000","last_clean":"2024-09-19T07:07:14.063794+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:14.063794+0000","last_undegraded":"2024-09-19T07:07:14.063794+0000","last_fullsized":"2024-09-19T07:07:14.063794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394432+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:06:35.394432+0000","last_peered":"2024-09-19T07:06:35.394432+0000","last_clean":"2024-09-19T07:06:35.394432+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:06:35.394432+0000","last_undegraded":"2024-09-19T07:06:35.394432+0000","last_fullsized":"2024-09-19T07:06:35.394432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061744+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:14.061744+0000","last_peered":"2024-09-19T07:07:14.061744+0000","last_clean":"2024-09-19T07:07:14.061744+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:14.061744+0000","last_undegraded":"2024-09-19T07:07:14.061744+0000","last_fullsized":"2024-09-19T07:07:14.061744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064659+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:14.064659+0000","last_peered":"2024-09-19T07:07:14.064659+0000","last_clean":"2024-09-19T07:07:14.064659+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:14.064659+0000","last_undegraded":"2024-09-19T07:07:14.064659+0000","last_fullsized":"2024-09-19T07:07:14.064659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828649+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:06:34.828649+0000","last_peered":"2024-09-19T07:06:34.828649+0000","last_clean":"2024-09-19T07:06:34.828649+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:06:34.828649+0000","last_undegraded":"2024-09-19T07:06:34.828649+0000","last_fullsized":"2024-09-19T07:06:34.828649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.822259+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:06:34.822259+0000","last_peered":"2024-09-19T07:06:34.822259+0000","last_clean":"2024-09-19T07:06:34.822259+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:06:34.822259+0000","last_undegraded":"2024-09-19T07:06:34.822259+0000","last_fullsized":"2024-09-19T07:06:34.822259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.829121+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:06:34.829121+0000","last_peered":"2024-09-19T07:06:34.829121+0000","last_clean":"2024-09-19T07:06:34.829121+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:06:34.829121+0000","last_undegraded":"2024-09-19T07:06:34.829121+0000","last_fullsized":"2024-09-19T07:06:34.829121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061300+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:14.061300+0000","last_peered":"2024-09-19T07:07:14.061300+0000","last_clean":"2024-09-19T07:07:14.061300+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:14.061300+0000","last_undegraded":"2024-09-19T07:07:14.061300+0000","last_fullsized":"2024-09-19T07:07:14.061300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061158+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:14.061158+0000","last_peered":"2024-09-19T07:07:14.061158+0000","last_clean":"2024-09-19T07:07:14.061158+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:14.061158+0000","last_undegraded":"2024-09-19T07:07:14.061158+0000","last_fullsized":"2024-09-19T07:07:14.061158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061375+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:14.061375+0000","last_peered":"2024-09-19T07:07:14.061375+0000","last_clean":"2024-09-19T07:07:14.061375+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:14.061375+0000","last_undegraded":"2024-09-19T07:07:14.061375+0000","last_fullsized":"2024-09-19T07:07:14.061375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064571+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:14.064571+0000","last_peered":"2024-09-19T07:07:14.064571+0000","last_clean":"2024-09-19T07:07:14.064571+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:14.064571+0000","last_undegraded":"2024-09-19T07:07:14.064571+0000","last_fullsized":"2024-09-19T07:07:14.064571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393984+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:06:35.393984+0000","last_peered":"2024-09-19T07:06:35.393984+0000","last_clean":"2024-09-19T07:06:35.393984+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:06:35.393984+0000","last_undegraded":"2024-09-19T07:06:35.393984+0000","last_fullsized":"2024-09-19T07:06:35.393984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.322281+0000","last_change":"2024-09-19T07:06:24.778852+0000","last_active":"2024-09-19T07:06:35.322281+0000","last_peered":"2024-09-19T07:06:35.322281+0000","last_clean":"2024-09-19T07:06:35.322281+0000","last_became_active":"2024-09-19T07:06:24.778541+0000","last_became_peered":"2024-09-19T07:06:24.778541+0000","last_unstale":"2024-09-19T07:06:35.322281+0000","last_undegraded":"2024-09-19T07:06:35.322281+0000","last_fullsized":"2024-09-19T07:06:35.322281+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:50.576796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062439+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:14.062439+0000","last_peered":"2024-09-19T07:07:14.062439+0000","last_clean":"2024-09-19T07:07:14.062439+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:14.062439+0000","last_undegraded":"2024-09-19T07:07:14.062439+0000","last_fullsized":"2024-09-19T07:07:14.062439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393863+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:06:35.393863+0000","last_peered":"2024-09-19T07:06:35.393863+0000","last_clean":"2024-09-19T07:06:35.393863+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:06:35.393863+0000","last_undegraded":"2024-09-19T07:06:35.393863+0000","last_fullsized":"2024-09-19T07:06:35.393863+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.321837+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:06:35.321837+0000","last_peered":"2024-09-19T07:06:35.321837+0000","last_clean":"2024-09-19T07:06:35.321837+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:06:35.321837+0000","last_undegraded":"2024-09-19T07:06:35.321837+0000","last_fullsized":"2024-09-19T07:06:35.321837+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393576+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:06:35.393576+0000","last_peered":"2024-09-19T07:06:35.393576+0000","last_clean":"2024-09-19T07:06:35.393576+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:06:35.393576+0000","last_undegraded":"2024-09-19T07:06:35.393576+0000","last_fullsized":"2024-09-19T07:06:35.393576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393922+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:06:35.393922+0000","last_peered":"2024-09-19T07:06:35.393922+0000","last_clean":"2024-09-19T07:06:35.393922+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:06:35.393922+0000","last_undegraded":"2024-09-19T07:06:35.393922+0000","last_fullsized":"2024-09-19T07:06:35.393922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061884+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:14.061884+0000","last_peered":"2024-09-19T07:07:14.061884+0000","last_clean":"2024-09-19T07:07:14.061884+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:14.061884+0000","last_undegraded":"2024-09-19T07:07:14.061884+0000","last_fullsized":"2024-09-19T07:07:14.061884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062274+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:14.062274+0000","last_peered":"2024-09-19T07:07:14.062274+0000","last_clean":"2024-09-19T07:07:14.062274+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:14.062274+0000","last_undegraded":"2024-09-19T07:07:14.062274+0000","last_fullsized":"2024-09-19T07:07:14.062274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.829115+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:06:34.829115+0000","last_peered":"2024-09-19T07:06:34.829115+0000","last_clean":"2024-09-19T07:06:34.829115+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:06:34.829115+0000","last_undegraded":"2024-09-19T07:06:34.829115+0000","last_fullsized":"2024-09-19T07:06:34.829115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49896,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":69,"num_write":71,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":159836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514519,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":485693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743451,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1121257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906975,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":490371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168615,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":486297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":491179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1076243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":485715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215168,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":481701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":559807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1052672,"data_stored":540277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":481687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:07:17.247 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:07:17.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:17 smithi078 ceph-mon[34556]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 625 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-09-19T07:07:17.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:17 smithi078 ceph-mon[34556]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:17.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:17 smithi046 ceph-mon[34147]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 625 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.0 KiB/s wr, 3 op/s 2024-09-19T07:07:17.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:17 smithi046 ceph-mon[34147]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:17.505 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:18.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 -- 172.21.15.29:0/596766023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c10c170 msgr2=0x7f1e2c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:18.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 --2- 172.21.15.29:0/596766023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c10c170 0x7f1e2c10e610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009900 tx=0x7f1e2402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 -- 172.21.15.29:0/596766023 shutdown_connections 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 --2- 172.21.15.29:0/596766023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c10c170 0x7f1e2c10e610 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 --2- 172.21.15.29:0/596766023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e2c103660 0x7f1e2c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 --2- 172.21.15.29:0/596766023 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e2c102d40 0x7f1e2c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 -- 172.21.15.29:0/596766023 >> 172.21.15.29:0/596766023 conn(0x7f1e2c0fc7a0 msgr2=0x7f1e2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 -- 172.21.15.29:0/596766023 shutdown_connections 2024-09-19T07:07:18.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.991+0000 7f1e311a4640 1 -- 172.21.15.29:0/596766023 wait complete. 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 Processor -- start 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 -- start start 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e2c102d40 0x7f1e2c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 0x7f1e2c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e2c10c170 0x7f1e2c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c111de0 con 0x7f1e2c103660 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c111c60 con 0x7f1e2c10c170 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e311a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c111f60 con 0x7f1e2c102d40 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e2a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 0x7f1e2c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:18.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e2a59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 0x7f1e2c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52668/0 (socket says 172.21.15.29:52668) 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.992+0000 7f1e2a59c640 1 -- 172.21.15.29:0/2708179653 learned_addr learned my addr 172.21.15.29:0/2708179653 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2b59e640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e2c10c170 0x7f1e2c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2ad9d640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e2c102d40 0x7f1e2c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2a59c640 1 -- 172.21.15.29:0/2708179653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e2c102d40 msgr2=0x7f1e2c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2a59c640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e2c102d40 0x7f1e2c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2a59c640 1 -- 172.21.15.29:0/2708179653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e2c10c170 msgr2=0x7f1e2c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2a59c640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e2c10c170 0x7f1e2c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2a59c640 1 -- 172.21.15.29:0/2708179653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2c19d370 con 0x7f1e2c103660 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e2a59c640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 0x7f1e2c198900 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000c940 tx=0x7f1e2000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20004220 con 0x7f1e2c103660 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e200043c0 con 0x7f1e2c103660 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2c19d660 con 0x7f1e2c103660 2024-09-19T07:07:18.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20004a00 con 0x7f1e2c103660 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.993+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2c1a4f40 con 0x7f1e2c103660 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.994+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2c103120 con 0x7f1e2c103660 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.995+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1e200079b0 con 0x7f1e2c103660 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.996+0000 7f1e13fff640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1e140a32d0 0x7f1e140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.996+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f1e200cfd70 con 0x7f1e2c103660 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.996+0000 7f1e2ad9d640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1e140a32d0 0x7f1e140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:17.997+0000 7f1e2ad9d640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1e140a32d0 0x7f1e140a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c005fd0 tx=0x7f1e1c0098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:18.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.000+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e20014030 con 0x7f1e2c103660 2024-09-19T07:07:18.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.172+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e2c062630 con 0x7f1e140a32d0 2024-09-19T07:07:18.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.182+0000 7f1e13fff640 1 -- 172.21.15.29:0/2708179653 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340270 (secure 0 0 0) 0x7f1e2c062630 con 0x7f1e140a32d0 2024-09-19T07:07:18.188 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:18.189 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1e140a32d0 msgr2=0x7f1e140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1e140a32d0 0x7f1e140a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c005fd0 tx=0x7f1e1c0098b0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 msgr2=0x7f1e2c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 0x7f1e2c198900 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000c940 tx=0x7f1e2000ce00 comp rx=0 tx=0).stop 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 shutdown_connections 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e2c10c170 0x7f1e2c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e2c103660 0x7f1e2c198900 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1e140a32d0 0x7f1e140a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 --2- 172.21.15.29:0/2708179653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e2c102d40 0x7f1e2c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 >> 172.21.15.29:0/2708179653 conn(0x7f1e2c0fc7a0 msgr2=0x7f1e2c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 shutdown_connections 2024-09-19T07:07:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:18.186+0000 7f1e311a4640 1 -- 172.21.15.29:0/2708179653 wait complete. 2024-09-19T07:07:19.034 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-19T07:07:17.854627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650646,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":173,"num_read_kb":193,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":400452,"kb_used_data":13712,"kb_used_omap":18,"kb_used_meta":386477,"kb_avail":1124541372,"statfs":{"total":1151940427776,"available":1151530364928,"internally_reserved":0,"allocated":14041088,"data_stored":7885160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":395752764},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34900,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":45,"num_write":24,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001995"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.091196+0000","last_change":"2024-09-19T07:07:15.091196+0000","last_active":"2024-09-19T07:07:15.091196+0000","last_peered":"2024-09-19T07:07:15.091196+0000","last_clean":"2024-09-19T07:07:15.091196+0000","last_became_active":"2024-09-19T07:07:15.087619+0000","last_became_peered":"2024-09-19T07:07:15.087619+0000","last_unstale":"2024-09-19T07:07:15.091196+0000","last_undegraded":"2024-09-19T07:07:15.091196+0000","last_fullsized":"2024-09-19T07:07:15.091196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:01.778892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059328+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:07:15.059328+0000","last_peered":"2024-09-19T07:07:15.059328+0000","last_clean":"2024-09-19T07:07:15.059328+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:07:15.059328+0000","last_undegraded":"2024-09-19T07:07:15.059328+0000","last_fullsized":"2024-09-19T07:07:15.059328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059519+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:07:15.059519+0000","last_peered":"2024-09-19T07:07:15.059519+0000","last_clean":"2024-09-19T07:07:15.059519+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:07:15.059519+0000","last_undegraded":"2024-09-19T07:07:15.059519+0000","last_fullsized":"2024-09-19T07:07:15.059519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062329+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:14.062329+0000","last_peered":"2024-09-19T07:07:14.062329+0000","last_clean":"2024-09-19T07:07:14.062329+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:14.062329+0000","last_undegraded":"2024-09-19T07:07:14.062329+0000","last_fullsized":"2024-09-19T07:07:14.062329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393225+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:06:35.393225+0000","last_peered":"2024-09-19T07:06:35.393225+0000","last_clean":"2024-09-19T07:06:35.393225+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:06:35.393225+0000","last_undegraded":"2024-09-19T07:06:35.393225+0000","last_fullsized":"2024-09-19T07:06:35.393225+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064869+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:07:15.064869+0000","last_peered":"2024-09-19T07:07:15.064869+0000","last_clean":"2024-09-19T07:07:15.064869+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:07:15.064869+0000","last_undegraded":"2024-09-19T07:07:15.064869+0000","last_fullsized":"2024-09-19T07:07:15.064869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062028+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:14.062028+0000","last_peered":"2024-09-19T07:07:14.062028+0000","last_clean":"2024-09-19T07:07:14.062028+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:14.062028+0000","last_undegraded":"2024-09-19T07:07:14.062028+0000","last_fullsized":"2024-09-19T07:07:14.062028+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393864+0000","last_change":"2024-09-19T07:06:31.838573+0000","last_active":"2024-09-19T07:06:35.393864+0000","last_peered":"2024-09-19T07:06:35.393864+0000","last_clean":"2024-09-19T07:06:35.393864+0000","last_became_active":"2024-09-19T07:06:31.837894+0000","last_became_peered":"2024-09-19T07:06:31.837894+0000","last_unstale":"2024-09-19T07:06:35.393864+0000","last_undegraded":"2024-09-19T07:06:35.393864+0000","last_fullsized":"2024-09-19T07:06:35.393864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:23.155205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.065231+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:07:15.065231+0000","last_peered":"2024-09-19T07:07:15.065231+0000","last_clean":"2024-09-19T07:07:15.065231+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:07:15.065231+0000","last_undegraded":"2024-09-19T07:07:15.065231+0000","last_fullsized":"2024-09-19T07:07:15.065231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063450+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:14.063450+0000","last_peered":"2024-09-19T07:07:14.063450+0000","last_clean":"2024-09-19T07:07:14.063450+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:14.063450+0000","last_undegraded":"2024-09-19T07:07:14.063450+0000","last_fullsized":"2024-09-19T07:07:14.063450+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393550+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:06:35.393550+0000","last_peered":"2024-09-19T07:06:35.393550+0000","last_clean":"2024-09-19T07:06:35.393550+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:06:35.393550+0000","last_undegraded":"2024-09-19T07:06:35.393550+0000","last_fullsized":"2024-09-19T07:06:35.393550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.072152+0000","last_change":"2024-09-19T07:07:15.072152+0000","last_active":"2024-09-19T07:07:15.072152+0000","last_peered":"2024-09-19T07:07:15.072152+0000","last_clean":"2024-09-19T07:07:15.072152+0000","last_became_active":"2024-09-19T07:07:15.066108+0000","last_became_peered":"2024-09-19T07:07:15.066108+0000","last_unstale":"2024-09-19T07:07:15.072152+0000","last_undegraded":"2024-09-19T07:07:15.072152+0000","last_fullsized":"2024-09-19T07:07:15.072152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:29.370693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394321+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:06:35.394321+0000","last_peered":"2024-09-19T07:06:35.394321+0000","last_clean":"2024-09-19T07:06:35.394321+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:06:35.394321+0000","last_undegraded":"2024-09-19T07:06:35.394321+0000","last_fullsized":"2024-09-19T07:06:35.394321+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059299+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:07:15.059299+0000","last_peered":"2024-09-19T07:07:15.059299+0000","last_clean":"2024-09-19T07:07:15.059299+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:07:15.059299+0000","last_undegraded":"2024-09-19T07:07:15.059299+0000","last_fullsized":"2024-09-19T07:07:15.059299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.148123+0000","last_change":"2024-09-19T07:06:22.663481+0000","last_active":"2024-09-19T07:06:35.148123+0000","last_peered":"2024-09-19T07:06:35.148123+0000","last_clean":"2024-09-19T07:06:35.148123+0000","last_became_active":"2024-09-19T07:06:22.662746+0000","last_became_peered":"2024-09-19T07:06:22.662746+0000","last_unstale":"2024-09-19T07:06:35.148123+0000","last_undegraded":"2024-09-19T07:06:35.148123+0000","last_fullsized":"2024-09-19T07:06:35.148123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:57.956780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393852+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:06:35.393852+0000","last_peered":"2024-09-19T07:06:35.393852+0000","last_clean":"2024-09-19T07:06:35.393852+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:06:35.393852+0000","last_undegraded":"2024-09-19T07:06:35.393852+0000","last_fullsized":"2024-09-19T07:06:35.393852+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828500+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:06:34.828500+0000","last_peered":"2024-09-19T07:06:34.828500+0000","last_clean":"2024-09-19T07:06:34.828500+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:06:34.828500+0000","last_undegraded":"2024-09-19T07:06:34.828500+0000","last_fullsized":"2024-09-19T07:06:34.828500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059936+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:07:15.059936+0000","last_peered":"2024-09-19T07:07:15.059936+0000","last_clean":"2024-09-19T07:07:15.059936+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:07:15.059936+0000","last_undegraded":"2024-09-19T07:07:15.059936+0000","last_fullsized":"2024-09-19T07:07:15.059936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067359+0000","last_change":"2024-09-19T07:07:15.067359+0000","last_active":"2024-09-19T07:07:15.067359+0000","last_peered":"2024-09-19T07:07:15.067359+0000","last_clean":"2024-09-19T07:07:15.067359+0000","last_became_active":"2024-09-19T07:07:15.066885+0000","last_became_peered":"2024-09-19T07:07:15.066885+0000","last_unstale":"2024-09-19T07:07:15.067359+0000","last_undegraded":"2024-09-19T07:07:15.067359+0000","last_fullsized":"2024-09-19T07:07:15.067359+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:35.148606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059417+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:07:15.059417+0000","last_peered":"2024-09-19T07:07:15.059417+0000","last_clean":"2024-09-19T07:07:15.059417+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:07:15.059417+0000","last_undegraded":"2024-09-19T07:07:15.059417+0000","last_fullsized":"2024-09-19T07:07:15.059417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061498+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:14.061498+0000","last_peered":"2024-09-19T07:07:14.061498+0000","last_clean":"2024-09-19T07:07:14.061498+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:14.061498+0000","last_undegraded":"2024-09-19T07:07:14.061498+0000","last_fullsized":"2024-09-19T07:07:14.061498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394111+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:06:35.394111+0000","last_peered":"2024-09-19T07:06:35.394111+0000","last_clean":"2024-09-19T07:06:35.394111+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:06:35.394111+0000","last_undegraded":"2024-09-19T07:06:35.394111+0000","last_fullsized":"2024-09-19T07:06:35.394111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062369+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:14.062369+0000","last_peered":"2024-09-19T07:07:14.062369+0000","last_clean":"2024-09-19T07:07:14.062369+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:14.062369+0000","last_undegraded":"2024-09-19T07:07:14.062369+0000","last_fullsized":"2024-09-19T07:07:14.062369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394249+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:06:35.394249+0000","last_peered":"2024-09-19T07:06:35.394249+0000","last_clean":"2024-09-19T07:06:35.394249+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:06:35.394249+0000","last_undegraded":"2024-09-19T07:06:35.394249+0000","last_fullsized":"2024-09-19T07:06:35.394249+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060645+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:07:15.060645+0000","last_peered":"2024-09-19T07:07:15.060645+0000","last_clean":"2024-09-19T07:07:15.060645+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:07:15.060645+0000","last_undegraded":"2024-09-19T07:07:15.060645+0000","last_fullsized":"2024-09-19T07:07:15.060645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060984+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:15.060984+0000","last_peered":"2024-09-19T07:07:15.060984+0000","last_clean":"2024-09-19T07:07:15.060984+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:15.060984+0000","last_undegraded":"2024-09-19T07:07:15.060984+0000","last_fullsized":"2024-09-19T07:07:15.060984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058971+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:07:15.058971+0000","last_peered":"2024-09-19T07:07:15.058971+0000","last_clean":"2024-09-19T07:07:15.058971+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:07:15.058971+0000","last_undegraded":"2024-09-19T07:07:15.058971+0000","last_fullsized":"2024-09-19T07:07:15.058971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064844+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:14.064844+0000","last_peered":"2024-09-19T07:07:14.064844+0000","last_clean":"2024-09-19T07:07:14.064844+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:14.064844+0000","last_undegraded":"2024-09-19T07:07:14.064844+0000","last_fullsized":"2024-09-19T07:07:14.064844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064970+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:07:15.064970+0000","last_peered":"2024-09-19T07:07:15.064970+0000","last_clean":"2024-09-19T07:07:15.064970+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:07:15.064970+0000","last_undegraded":"2024-09-19T07:07:15.064970+0000","last_fullsized":"2024-09-19T07:07:15.064970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828671+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:06:34.828671+0000","last_peered":"2024-09-19T07:06:34.828671+0000","last_clean":"2024-09-19T07:06:34.828671+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:06:34.828671+0000","last_undegraded":"2024-09-19T07:06:34.828671+0000","last_fullsized":"2024-09-19T07:06:34.828671+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061661+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:07:15.061661+0000","last_peered":"2024-09-19T07:07:15.061661+0000","last_clean":"2024-09-19T07:07:15.061661+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:07:15.061661+0000","last_undegraded":"2024-09-19T07:07:15.061661+0000","last_fullsized":"2024-09-19T07:07:15.061661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060362+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:07:15.060362+0000","last_peered":"2024-09-19T07:07:15.060362+0000","last_clean":"2024-09-19T07:07:15.060362+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:07:15.060362+0000","last_undegraded":"2024-09-19T07:07:15.060362+0000","last_fullsized":"2024-09-19T07:07:15.060362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062221+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:07:15.062221+0000","last_peered":"2024-09-19T07:07:15.062221+0000","last_clean":"2024-09-19T07:07:15.062221+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:07:15.062221+0000","last_undegraded":"2024-09-19T07:07:15.062221+0000","last_fullsized":"2024-09-19T07:07:15.062221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062339+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:07:15.062339+0000","last_peered":"2024-09-19T07:07:15.062339+0000","last_clean":"2024-09-19T07:07:15.062339+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:07:15.062339+0000","last_undegraded":"2024-09-19T07:07:15.062339+0000","last_fullsized":"2024-09-19T07:07:15.062339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064749+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:14.064749+0000","last_peered":"2024-09-19T07:07:14.064749+0000","last_clean":"2024-09-19T07:07:14.064749+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:14.064749+0000","last_undegraded":"2024-09-19T07:07:14.064749+0000","last_fullsized":"2024-09-19T07:07:14.064749+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063853+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:14.063853+0000","last_peered":"2024-09-19T07:07:14.063853+0000","last_clean":"2024-09-19T07:07:14.063853+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:14.063853+0000","last_undegraded":"2024-09-19T07:07:14.063853+0000","last_fullsized":"2024-09-19T07:07:14.063853+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064207+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:14.064207+0000","last_peered":"2024-09-19T07:07:14.064207+0000","last_clean":"2024-09-19T07:07:14.064207+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:14.064207+0000","last_undegraded":"2024-09-19T07:07:14.064207+0000","last_fullsized":"2024-09-19T07:07:14.064207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.065046+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:14.065046+0000","last_peered":"2024-09-19T07:07:14.065046+0000","last_clean":"2024-09-19T07:07:14.065046+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:14.065046+0000","last_undegraded":"2024-09-19T07:07:14.065046+0000","last_fullsized":"2024-09-19T07:07:14.065046+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064090+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:14.064090+0000","last_peered":"2024-09-19T07:07:14.064090+0000","last_clean":"2024-09-19T07:07:14.064090+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:14.064090+0000","last_undegraded":"2024-09-19T07:07:14.064090+0000","last_fullsized":"2024-09-19T07:07:14.064090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063558+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:14.063558+0000","last_peered":"2024-09-19T07:07:14.063558+0000","last_clean":"2024-09-19T07:07:14.063558+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:14.063558+0000","last_undegraded":"2024-09-19T07:07:14.063558+0000","last_fullsized":"2024-09-19T07:07:14.063558+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059640+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:07:15.059640+0000","last_peered":"2024-09-19T07:07:15.059640+0000","last_clean":"2024-09-19T07:07:15.059640+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:07:15.059640+0000","last_undegraded":"2024-09-19T07:07:15.059640+0000","last_fullsized":"2024-09-19T07:07:15.059640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394113+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:06:35.394113+0000","last_peered":"2024-09-19T07:06:35.394113+0000","last_clean":"2024-09-19T07:06:35.394113+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:06:35.394113+0000","last_undegraded":"2024-09-19T07:06:35.394113+0000","last_fullsized":"2024-09-19T07:06:35.394113+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057575+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057575+0000","last_peered":"2024-09-19T07:07:15.057575+0000","last_clean":"2024-09-19T07:07:15.057575+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057575+0000","last_undegraded":"2024-09-19T07:07:15.057575+0000","last_fullsized":"2024-09-19T07:07:15.057575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061584+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:14.061584+0000","last_peered":"2024-09-19T07:07:14.061584+0000","last_clean":"2024-09-19T07:07:14.061584+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:14.061584+0000","last_undegraded":"2024-09-19T07:07:14.061584+0000","last_fullsized":"2024-09-19T07:07:14.061584+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063775+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:14.063775+0000","last_peered":"2024-09-19T07:07:14.063775+0000","last_clean":"2024-09-19T07:07:14.063775+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:14.063775+0000","last_undegraded":"2024-09-19T07:07:14.063775+0000","last_fullsized":"2024-09-19T07:07:14.063775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061633+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:14.061633+0000","last_peered":"2024-09-19T07:07:14.061633+0000","last_clean":"2024-09-19T07:07:14.061633+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:14.061633+0000","last_undegraded":"2024-09-19T07:07:14.061633+0000","last_fullsized":"2024-09-19T07:07:14.061633+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":33,"reported_epoch":88,"state":"peering","last_fresh":"2024-09-19T07:06:35.394458+0000","last_change":"2024-09-19T07:07:14.064624+0000","last_active":"2024-09-19T07:07:14.064624+0000","last_peered":"2024-09-19T07:06:35.394458+0000","last_clean":"2024-09-19T07:06:35.394458+0000","last_became_active":"2024-09-19T07:06:22.667893+0000","last_became_peered":"2024-09-19T07:06:22.667893+0000","last_unstale":"2024-09-19T07:06:35.394458+0000","last_undegraded":"2024-09-19T07:06:35.394458+0000","last_fullsized":"2024-09-19T07:06:35.394458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063579+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:14.063579+0000","last_peered":"2024-09-19T07:07:14.063579+0000","last_clean":"2024-09-19T07:07:14.063579+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:14.063579+0000","last_undegraded":"2024-09-19T07:07:14.063579+0000","last_fullsized":"2024-09-19T07:07:14.063579+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828780+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:06:34.828780+0000","last_peered":"2024-09-19T07:06:34.828780+0000","last_clean":"2024-09-19T07:06:34.828780+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:06:34.828780+0000","last_undegraded":"2024-09-19T07:06:34.828780+0000","last_fullsized":"2024-09-19T07:06:34.828780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.394105+0000","last_change":"2024-09-19T07:06:22.663928+0000","last_active":"2024-09-19T07:06:35.394105+0000","last_peered":"2024-09-19T07:06:35.394105+0000","last_clean":"2024-09-19T07:06:35.394105+0000","last_became_active":"2024-09-19T07:06:22.663626+0000","last_became_peered":"2024-09-19T07:06:22.663626+0000","last_unstale":"2024-09-19T07:06:35.394105+0000","last_undegraded":"2024-09-19T07:06:35.394105+0000","last_fullsized":"2024-09-19T07:06:35.394105+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:06.258825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062945+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:14.062945+0000","last_peered":"2024-09-19T07:07:14.062945+0000","last_clean":"2024-09-19T07:07:14.062945+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:14.062945+0000","last_undegraded":"2024-09-19T07:07:14.062945+0000","last_fullsized":"2024-09-19T07:07:14.062945+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063200+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:14.063200+0000","last_peered":"2024-09-19T07:07:14.063200+0000","last_clean":"2024-09-19T07:07:14.063200+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:14.063200+0000","last_undegraded":"2024-09-19T07:07:14.063200+0000","last_fullsized":"2024-09-19T07:07:14.063200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062951+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:07:15.062951+0000","last_peered":"2024-09-19T07:07:15.062951+0000","last_clean":"2024-09-19T07:07:15.062951+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:07:15.062951+0000","last_undegraded":"2024-09-19T07:07:15.062951+0000","last_fullsized":"2024-09-19T07:07:15.062951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.065037+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:14.065037+0000","last_peered":"2024-09-19T07:07:14.065037+0000","last_clean":"2024-09-19T07:07:14.065037+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:14.065037+0000","last_undegraded":"2024-09-19T07:07:14.065037+0000","last_fullsized":"2024-09-19T07:07:14.065037+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393849+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:06:35.393849+0000","last_peered":"2024-09-19T07:06:35.393849+0000","last_clean":"2024-09-19T07:06:35.393849+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:06:35.393849+0000","last_undegraded":"2024-09-19T07:06:35.393849+0000","last_fullsized":"2024-09-19T07:06:35.393849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061227+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:07:15.061227+0000","last_peered":"2024-09-19T07:07:15.061227+0000","last_clean":"2024-09-19T07:07:15.061227+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:07:15.061227+0000","last_undegraded":"2024-09-19T07:07:15.061227+0000","last_fullsized":"2024-09-19T07:07:15.061227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063096+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:14.063096+0000","last_peered":"2024-09-19T07:07:14.063096+0000","last_clean":"2024-09-19T07:07:14.063096+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:14.063096+0000","last_undegraded":"2024-09-19T07:07:14.063096+0000","last_fullsized":"2024-09-19T07:07:14.063096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828766+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:06:34.828766+0000","last_peered":"2024-09-19T07:06:34.828766+0000","last_clean":"2024-09-19T07:06:34.828766+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:06:34.828766+0000","last_undegraded":"2024-09-19T07:06:34.828766+0000","last_fullsized":"2024-09-19T07:06:34.828766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064453+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:14.064453+0000","last_peered":"2024-09-19T07:07:14.064453+0000","last_clean":"2024-09-19T07:07:14.064453+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:14.064453+0000","last_undegraded":"2024-09-19T07:07:14.064453+0000","last_fullsized":"2024-09-19T07:07:14.064453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063795+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:14.063795+0000","last_peered":"2024-09-19T07:07:14.063795+0000","last_clean":"2024-09-19T07:07:14.063795+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:14.063795+0000","last_undegraded":"2024-09-19T07:07:14.063795+0000","last_fullsized":"2024-09-19T07:07:14.063795+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064712+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:07:15.064712+0000","last_peered":"2024-09-19T07:07:15.064712+0000","last_clean":"2024-09-19T07:07:15.064712+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:07:15.064712+0000","last_undegraded":"2024-09-19T07:07:15.064712+0000","last_fullsized":"2024-09-19T07:07:15.064712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'28","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:17.043862+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:07:17.043862+0000","last_peered":"2024-09-19T07:07:17.043862+0000","last_clean":"2024-09-19T07:07:17.043862+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:07:17.043862+0000","last_undegraded":"2024-09-19T07:07:17.043862+0000","last_fullsized":"2024-09-19T07:07:17.043862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59246,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":78,"num_write":28,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060105+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:07:15.060105+0000","last_peered":"2024-09-19T07:07:15.060105+0000","last_clean":"2024-09-19T07:07:15.060105+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:07:15.060105+0000","last_undegraded":"2024-09-19T07:07:15.060105+0000","last_fullsized":"2024-09-19T07:07:15.060105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062136+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:14.062136+0000","last_peered":"2024-09-19T07:07:14.062136+0000","last_clean":"2024-09-19T07:07:14.062136+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:14.062136+0000","last_undegraded":"2024-09-19T07:07:14.062136+0000","last_fullsized":"2024-09-19T07:07:14.062136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063662+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:14.063662+0000","last_peered":"2024-09-19T07:07:14.063662+0000","last_clean":"2024-09-19T07:07:14.063662+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:14.063662+0000","last_undegraded":"2024-09-19T07:07:14.063662+0000","last_fullsized":"2024-09-19T07:07:14.063662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393682+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:06:35.393682+0000","last_peered":"2024-09-19T07:06:35.393682+0000","last_clean":"2024-09-19T07:06:35.393682+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:06:35.393682+0000","last_undegraded":"2024-09-19T07:06:35.393682+0000","last_fullsized":"2024-09-19T07:06:35.393682+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062424+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:14.062424+0000","last_peered":"2024-09-19T07:07:14.062424+0000","last_clean":"2024-09-19T07:07:14.062424+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:14.062424+0000","last_undegraded":"2024-09-19T07:07:14.062424+0000","last_fullsized":"2024-09-19T07:07:14.062424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059369+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:07:15.059369+0000","last_peered":"2024-09-19T07:07:15.059369+0000","last_clean":"2024-09-19T07:07:15.059369+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:07:15.059369+0000","last_undegraded":"2024-09-19T07:07:15.059369+0000","last_fullsized":"2024-09-19T07:07:15.059369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062096+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:14.062096+0000","last_peered":"2024-09-19T07:07:14.062096+0000","last_clean":"2024-09-19T07:07:14.062096+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:14.062096+0000","last_undegraded":"2024-09-19T07:07:14.062096+0000","last_fullsized":"2024-09-19T07:07:14.062096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062233+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:07:15.062233+0000","last_peered":"2024-09-19T07:07:15.062233+0000","last_clean":"2024-09-19T07:07:15.062233+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:07:15.062233+0000","last_undegraded":"2024-09-19T07:07:15.062233+0000","last_fullsized":"2024-09-19T07:07:15.062233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059669+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:07:15.059669+0000","last_peered":"2024-09-19T07:07:15.059669+0000","last_clean":"2024-09-19T07:07:15.059669+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:07:15.059669+0000","last_undegraded":"2024-09-19T07:07:15.059669+0000","last_fullsized":"2024-09-19T07:07:15.059669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062102+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:14.062102+0000","last_peered":"2024-09-19T07:07:14.062102+0000","last_clean":"2024-09-19T07:07:14.062102+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:14.062102+0000","last_undegraded":"2024-09-19T07:07:14.062102+0000","last_fullsized":"2024-09-19T07:07:14.062102+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059855+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:07:15.059855+0000","last_peered":"2024-09-19T07:07:15.059855+0000","last_clean":"2024-09-19T07:07:15.059855+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:07:15.059855+0000","last_undegraded":"2024-09-19T07:07:15.059855+0000","last_fullsized":"2024-09-19T07:07:15.059855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064022+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:14.064022+0000","last_peered":"2024-09-19T07:07:14.064022+0000","last_clean":"2024-09-19T07:07:14.064022+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:14.064022+0000","last_undegraded":"2024-09-19T07:07:14.064022+0000","last_fullsized":"2024-09-19T07:07:14.064022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828894+0000","last_change":"2024-09-19T07:06:31.834092+0000","last_active":"2024-09-19T07:06:34.828894+0000","last_peered":"2024-09-19T07:06:34.828894+0000","last_clean":"2024-09-19T07:06:34.828894+0000","last_became_active":"2024-09-19T07:06:31.833617+0000","last_became_peered":"2024-09-19T07:06:31.833617+0000","last_unstale":"2024-09-19T07:06:34.828894+0000","last_undegraded":"2024-09-19T07:06:34.828894+0000","last_fullsized":"2024-09-19T07:06:34.828894+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:50.240102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059113+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:07:15.059113+0000","last_peered":"2024-09-19T07:07:15.059113+0000","last_clean":"2024-09-19T07:07:15.059113+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:07:15.059113+0000","last_undegraded":"2024-09-19T07:07:15.059113+0000","last_fullsized":"2024-09-19T07:07:15.059113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064206+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:14.064206+0000","last_peered":"2024-09-19T07:07:14.064206+0000","last_clean":"2024-09-19T07:07:14.064206+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:14.064206+0000","last_undegraded":"2024-09-19T07:07:14.064206+0000","last_fullsized":"2024-09-19T07:07:14.064206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061522+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:07:15.061522+0000","last_peered":"2024-09-19T07:07:15.061522+0000","last_clean":"2024-09-19T07:07:15.061522+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:07:15.061522+0000","last_undegraded":"2024-09-19T07:07:15.061522+0000","last_fullsized":"2024-09-19T07:07:15.061522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062773+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:14.062773+0000","last_peered":"2024-09-19T07:07:14.062773+0000","last_clean":"2024-09-19T07:07:14.062773+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:14.062773+0000","last_undegraded":"2024-09-19T07:07:14.062773+0000","last_fullsized":"2024-09-19T07:07:14.062773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062934+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:14.062934+0000","last_peered":"2024-09-19T07:07:14.062934+0000","last_clean":"2024-09-19T07:07:14.062934+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:14.062934+0000","last_undegraded":"2024-09-19T07:07:14.062934+0000","last_fullsized":"2024-09-19T07:07:14.062934+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062435+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:07:15.062435+0000","last_peered":"2024-09-19T07:07:15.062435+0000","last_clean":"2024-09-19T07:07:15.062435+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:07:15.062435+0000","last_undegraded":"2024-09-19T07:07:15.062435+0000","last_fullsized":"2024-09-19T07:07:15.062435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828407+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:06:34.828407+0000","last_peered":"2024-09-19T07:06:34.828407+0000","last_clean":"2024-09-19T07:06:34.828407+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:06:34.828407+0000","last_undegraded":"2024-09-19T07:06:34.828407+0000","last_fullsized":"2024-09-19T07:06:34.828407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061720+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:14.061720+0000","last_peered":"2024-09-19T07:07:14.061720+0000","last_clean":"2024-09-19T07:07:14.061720+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:14.061720+0000","last_undegraded":"2024-09-19T07:07:14.061720+0000","last_fullsized":"2024-09-19T07:07:14.061720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064824+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:14.064824+0000","last_peered":"2024-09-19T07:07:14.064824+0000","last_clean":"2024-09-19T07:07:14.064824+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:14.064824+0000","last_undegraded":"2024-09-19T07:07:14.064824+0000","last_fullsized":"2024-09-19T07:07:14.064824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828940+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:06:34.828940+0000","last_peered":"2024-09-19T07:06:34.828940+0000","last_clean":"2024-09-19T07:06:34.828940+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:06:34.828940+0000","last_undegraded":"2024-09-19T07:06:34.828940+0000","last_fullsized":"2024-09-19T07:06:34.828940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.063794+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:14.063794+0000","last_peered":"2024-09-19T07:07:14.063794+0000","last_clean":"2024-09-19T07:07:14.063794+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:14.063794+0000","last_undegraded":"2024-09-19T07:07:14.063794+0000","last_fullsized":"2024-09-19T07:07:14.063794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059836+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:07:15.059836+0000","last_peered":"2024-09-19T07:07:15.059836+0000","last_clean":"2024-09-19T07:07:15.059836+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:07:15.059836+0000","last_undegraded":"2024-09-19T07:07:15.059836+0000","last_fullsized":"2024-09-19T07:07:15.059836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061744+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:14.061744+0000","last_peered":"2024-09-19T07:07:14.061744+0000","last_clean":"2024-09-19T07:07:14.061744+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:14.061744+0000","last_undegraded":"2024-09-19T07:07:14.061744+0000","last_fullsized":"2024-09-19T07:07:14.061744+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064659+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:14.064659+0000","last_peered":"2024-09-19T07:07:14.064659+0000","last_clean":"2024-09-19T07:07:14.064659+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:14.064659+0000","last_undegraded":"2024-09-19T07:07:14.064659+0000","last_fullsized":"2024-09-19T07:07:14.064659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.828649+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:06:34.828649+0000","last_peered":"2024-09-19T07:06:34.828649+0000","last_clean":"2024-09-19T07:06:34.828649+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:06:34.828649+0000","last_undegraded":"2024-09-19T07:06:34.828649+0000","last_fullsized":"2024-09-19T07:06:34.828649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060878+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:07:15.060878+0000","last_peered":"2024-09-19T07:07:15.060878+0000","last_clean":"2024-09-19T07:07:15.060878+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:07:15.060878+0000","last_undegraded":"2024-09-19T07:07:15.060878+0000","last_fullsized":"2024-09-19T07:07:15.060878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.829121+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:06:34.829121+0000","last_peered":"2024-09-19T07:06:34.829121+0000","last_clean":"2024-09-19T07:06:34.829121+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:06:34.829121+0000","last_undegraded":"2024-09-19T07:06:34.829121+0000","last_fullsized":"2024-09-19T07:06:34.829121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061300+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:14.061300+0000","last_peered":"2024-09-19T07:07:14.061300+0000","last_clean":"2024-09-19T07:07:14.061300+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:14.061300+0000","last_undegraded":"2024-09-19T07:07:14.061300+0000","last_fullsized":"2024-09-19T07:07:14.061300+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061158+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:14.061158+0000","last_peered":"2024-09-19T07:07:14.061158+0000","last_clean":"2024-09-19T07:07:14.061158+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:14.061158+0000","last_undegraded":"2024-09-19T07:07:14.061158+0000","last_fullsized":"2024-09-19T07:07:14.061158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061375+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:14.061375+0000","last_peered":"2024-09-19T07:07:14.061375+0000","last_clean":"2024-09-19T07:07:14.061375+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:14.061375+0000","last_undegraded":"2024-09-19T07:07:14.061375+0000","last_fullsized":"2024-09-19T07:07:14.061375+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.064571+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:14.064571+0000","last_peered":"2024-09-19T07:07:14.064571+0000","last_clean":"2024-09-19T07:07:14.064571+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:14.064571+0000","last_undegraded":"2024-09-19T07:07:14.064571+0000","last_fullsized":"2024-09-19T07:07:14.064571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393984+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:06:35.393984+0000","last_peered":"2024-09-19T07:06:35.393984+0000","last_clean":"2024-09-19T07:06:35.393984+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:06:35.393984+0000","last_undegraded":"2024-09-19T07:06:35.393984+0000","last_fullsized":"2024-09-19T07:06:35.393984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067182+0000","last_change":"2024-09-19T07:07:15.067182+0000","last_active":"2024-09-19T07:07:15.067182+0000","last_peered":"2024-09-19T07:07:15.067182+0000","last_clean":"2024-09-19T07:07:15.067182+0000","last_became_active":"2024-09-19T07:07:15.066805+0000","last_became_peered":"2024-09-19T07:07:15.066805+0000","last_unstale":"2024-09-19T07:07:15.067182+0000","last_undegraded":"2024-09-19T07:07:15.067182+0000","last_fullsized":"2024-09-19T07:07:15.067182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:05.606025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062439+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:14.062439+0000","last_peered":"2024-09-19T07:07:14.062439+0000","last_clean":"2024-09-19T07:07:14.062439+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:14.062439+0000","last_undegraded":"2024-09-19T07:07:14.062439+0000","last_fullsized":"2024-09-19T07:07:14.062439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059089+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:07:15.059089+0000","last_peered":"2024-09-19T07:07:15.059089+0000","last_clean":"2024-09-19T07:07:15.059089+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:07:15.059089+0000","last_undegraded":"2024-09-19T07:07:15.059089+0000","last_fullsized":"2024-09-19T07:07:15.059089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061406+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:07:15.061406+0000","last_peered":"2024-09-19T07:07:15.061406+0000","last_clean":"2024-09-19T07:07:15.061406+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:07:15.061406+0000","last_undegraded":"2024-09-19T07:07:15.061406+0000","last_fullsized":"2024-09-19T07:07:15.061406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064389+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:07:15.064389+0000","last_peered":"2024-09-19T07:07:15.064389+0000","last_clean":"2024-09-19T07:07:15.064389+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:07:15.064389+0000","last_undegraded":"2024-09-19T07:07:15.064389+0000","last_fullsized":"2024-09-19T07:07:15.064389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:35.393922+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:06:35.393922+0000","last_peered":"2024-09-19T07:06:35.393922+0000","last_clean":"2024-09-19T07:06:35.393922+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:06:35.393922+0000","last_undegraded":"2024-09-19T07:06:35.393922+0000","last_fullsized":"2024-09-19T07:06:35.393922+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.061884+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:14.061884+0000","last_peered":"2024-09-19T07:07:14.061884+0000","last_clean":"2024-09-19T07:07:14.061884+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:14.061884+0000","last_undegraded":"2024-09-19T07:07:14.061884+0000","last_fullsized":"2024-09-19T07:07:14.061884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T07:07:14.062274+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:14.062274+0000","last_peered":"2024-09-19T07:07:14.062274+0000","last_clean":"2024-09-19T07:07:14.062274+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:14.062274+0000","last_undegraded":"2024-09-19T07:07:14.062274+0000","last_fullsized":"2024-09-19T07:07:14.062274+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T07:06:34.829115+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:06:34.829115+0000","last_peered":"2024-09-19T07:06:34.829115+0000","last_clean":"2024-09-19T07:06:34.829115+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:06:34.829115+0000","last_undegraded":"2024-09-19T07:06:34.829115+0000","last_fullsized":"2024-09-19T07:06:34.829115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60044,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":47,"num_read_kb":84,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":169380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514519,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":983040,"data_stored":485693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743452,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1687552,"data_stored":1150335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906976,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1024000,"data_stored":509301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":504623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":995328,"data_stored":491179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32736,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712416,"statfs":{"total":95995035648,"available":95961513984,"internally_reserved":0,"allocated":1589248,"data_stored":1076243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":485715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":500631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":559807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1052672,"data_stored":540277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":481687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:07:19.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:07:19.304 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:19.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:19 smithi029 ceph-mon[31255]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 635 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.5 KiB/s wr, 5 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:07:19.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:19 smithi029 ceph-mon[31255]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:19.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:19 smithi078 ceph-mon[34556]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 635 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.5 KiB/s wr, 5 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:07:19.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:19 smithi078 ceph-mon[34556]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:19.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:19 smithi046 ceph-mon[34147]: pgmap v322: 129 pgs: 1 peering, 128 active+clean; 635 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.5 KiB/s wr, 5 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:07:19.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:19 smithi046 ceph-mon[34147]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:19.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.802+0000 7fc40cd84640 1 -- 172.21.15.29:0/1964919599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408101de0 msgr2=0x7fc4081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.802+0000 7fc40cd84640 1 --2- 172.21.15.29:0/1964919599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408101de0 0x7fc4081021c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8009900 tx=0x7fc3f802a410 comp rx=0 tx=0).stop 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 -- 172.21.15.29:0/1964919599 shutdown_connections 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 --2- 172.21.15.29:0/1964919599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc408106f10 0x7fc40810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 --2- 172.21.15.29:0/1964919599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc408102790 0x7fc4081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 --2- 172.21.15.29:0/1964919599 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408101de0 0x7fc4081021c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 -- 172.21.15.29:0/1964919599 >> 172.21.15.29:0/1964919599 conn(0x7fc4080fd8c0 msgr2=0x7fc4080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 -- 172.21.15.29:0/1964919599 shutdown_connections 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 -- 172.21.15.29:0/1964919599 wait complete. 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.803+0000 7fc40cd84640 1 Processor -- start 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 -- start start 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc408101de0 0x7fc408198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:19.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc408102790 0x7fc4081988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 0x7fc40819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc408111e20 con 0x7fc408106f10 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc408111ca0 con 0x7fc408101de0 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40cd84640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc408111fa0 con 0x7fc408102790 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 0x7fc40819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 0x7fc40819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52684/0 (socket says 172.21.15.29:52684) 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 -- 172.21.15.29:0/3055685683 learned_addr learned my addr 172.21.15.29:0/3055685683 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc405d9b640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc408102790 0x7fc4081988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc40659c640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc408101de0 0x7fc408198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 -- 172.21.15.29:0/3055685683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc408102790 msgr2=0x7fc4081988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc408102790 0x7fc4081988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 -- 172.21.15.29:0/3055685683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc408101de0 msgr2=0x7fc408198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:19.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc408101de0 0x7fc408198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.804+0000 7fc406d9d640 1 -- 172.21.15.29:0/3055685683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40819d330 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.805+0000 7fc406d9d640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 0x7fc40819cc50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc40000cad0 tx=0x7fc40000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.805+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40000ae20 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.805+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc400005020 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.805+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40819d620 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.805+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40000f6b0 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.805+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4081a4f00 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.806+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4081021c0 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.807+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc4000051d0 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.808+0000 7fc3f77fe640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f00a32d0 0x7fc3f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.808+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fc4000cfdf0 con 0x7fc408106f10 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.808+0000 7fc40659c640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f00a32d0 0x7fc3f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.808+0000 7fc40659c640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f00a32d0 0x7fc3f00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8031440 tx=0x7fc3f80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:19.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.812+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc400014030 con 0x7fc408106f10 2024-09-19T07:07:19.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.987+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc408062630 con 0x7fc3f00a32d0 2024-09-19T07:07:19.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.996+0000 7fc3f77fe640 1 -- 172.21.15.29:0/3055685683 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340316 (secure 0 0 0) 0x7fc408062630 con 0x7fc3f00a32d0 2024-09-19T07:07:20.004 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:20.006 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:19.999+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f00a32d0 msgr2=0x7fc3f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f00a32d0 0x7fc3f00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8031440 tx=0x7fc3f80095f0 comp rx=0 tx=0).stop 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 msgr2=0x7fc40819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 0x7fc40819cc50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc40000cad0 tx=0x7fc40000cf90 comp rx=0 tx=0).stop 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 shutdown_connections 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc408106f10 0x7fc40819cc50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f00a32d0 0x7fc3f00a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc408102790 0x7fc4081988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 --2- 172.21.15.29:0/3055685683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc408101de0 0x7fc408198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 >> 172.21.15.29:0/3055685683 conn(0x7fc4080fd8c0 msgr2=0x7fc4080fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 shutdown_connections 2024-09-19T07:07:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:20.000+0000 7fc40cd84640 1 -- 172.21.15.29:0/3055685683 wait complete. 2024-09-19T07:07:20.744 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-19T07:07:19.855069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650646,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":172,"num_read_kb":192,"num_write":264,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181340,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":423,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404820,"kb_used_data":13892,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537004,"statfs":{"total":1151940427776,"available":1151525892096,"internally_reserved":0,"allocated":14225408,"data_stored":7990328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34783,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":44,"num_write":17,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001814"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.091196+0000","last_change":"2024-09-19T07:07:15.091196+0000","last_active":"2024-09-19T07:07:15.091196+0000","last_peered":"2024-09-19T07:07:15.091196+0000","last_clean":"2024-09-19T07:07:15.091196+0000","last_became_active":"2024-09-19T07:07:15.087619+0000","last_became_peered":"2024-09-19T07:07:15.087619+0000","last_unstale":"2024-09-19T07:07:15.091196+0000","last_undegraded":"2024-09-19T07:07:15.091196+0000","last_fullsized":"2024-09-19T07:07:15.091196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:01.778892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059328+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:07:15.059328+0000","last_peered":"2024-09-19T07:07:15.059328+0000","last_clean":"2024-09-19T07:07:15.059328+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:07:15.059328+0000","last_undegraded":"2024-09-19T07:07:15.059328+0000","last_fullsized":"2024-09-19T07:07:15.059328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059519+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:07:15.059519+0000","last_peered":"2024-09-19T07:07:15.059519+0000","last_clean":"2024-09-19T07:07:15.059519+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:07:15.059519+0000","last_undegraded":"2024-09-19T07:07:15.059519+0000","last_fullsized":"2024-09-19T07:07:15.059519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178223+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:15.178223+0000","last_peered":"2024-09-19T07:07:15.178223+0000","last_clean":"2024-09-19T07:07:15.178223+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:15.178223+0000","last_undegraded":"2024-09-19T07:07:15.178223+0000","last_fullsized":"2024-09-19T07:07:15.178223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060171+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:07:15.060171+0000","last_peered":"2024-09-19T07:07:15.060171+0000","last_clean":"2024-09-19T07:07:15.060171+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:07:15.060171+0000","last_undegraded":"2024-09-19T07:07:15.060171+0000","last_fullsized":"2024-09-19T07:07:15.060171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064869+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:07:15.064869+0000","last_peered":"2024-09-19T07:07:15.064869+0000","last_clean":"2024-09-19T07:07:15.064869+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:07:15.064869+0000","last_undegraded":"2024-09-19T07:07:15.064869+0000","last_fullsized":"2024-09-19T07:07:15.064869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086202+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:15.086202+0000","last_peered":"2024-09-19T07:07:15.086202+0000","last_clean":"2024-09-19T07:07:15.086202+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:15.086202+0000","last_undegraded":"2024-09-19T07:07:15.086202+0000","last_fullsized":"2024-09-19T07:07:15.086202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064418+0000","last_change":"2024-09-19T07:07:15.064418+0000","last_active":"2024-09-19T07:07:15.064418+0000","last_peered":"2024-09-19T07:07:15.064418+0000","last_clean":"2024-09-19T07:07:15.064418+0000","last_became_active":"2024-09-19T07:07:15.063859+0000","last_became_peered":"2024-09-19T07:07:15.063859+0000","last_unstale":"2024-09-19T07:07:15.064418+0000","last_undegraded":"2024-09-19T07:07:15.064418+0000","last_fullsized":"2024-09-19T07:07:15.064418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:22.219231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,10,5],"acting":[4,3,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.065231+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:07:15.065231+0000","last_peered":"2024-09-19T07:07:15.065231+0000","last_clean":"2024-09-19T07:07:15.065231+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:07:15.065231+0000","last_undegraded":"2024-09-19T07:07:15.065231+0000","last_fullsized":"2024-09-19T07:07:15.065231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058483+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:15.058483+0000","last_peered":"2024-09-19T07:07:15.058483+0000","last_clean":"2024-09-19T07:07:15.058483+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:15.058483+0000","last_undegraded":"2024-09-19T07:07:15.058483+0000","last_fullsized":"2024-09-19T07:07:15.058483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060553+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:07:15.060553+0000","last_peered":"2024-09-19T07:07:15.060553+0000","last_clean":"2024-09-19T07:07:15.060553+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:07:15.060553+0000","last_undegraded":"2024-09-19T07:07:15.060553+0000","last_fullsized":"2024-09-19T07:07:15.060553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.072152+0000","last_change":"2024-09-19T07:07:15.072152+0000","last_active":"2024-09-19T07:07:15.072152+0000","last_peered":"2024-09-19T07:07:15.072152+0000","last_clean":"2024-09-19T07:07:15.072152+0000","last_became_active":"2024-09-19T07:07:15.066108+0000","last_became_peered":"2024-09-19T07:07:15.066108+0000","last_unstale":"2024-09-19T07:07:15.072152+0000","last_undegraded":"2024-09-19T07:07:15.072152+0000","last_fullsized":"2024-09-19T07:07:15.072152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:29.370693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060781+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:07:15.060781+0000","last_peered":"2024-09-19T07:07:15.060781+0000","last_clean":"2024-09-19T07:07:15.060781+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:07:15.060781+0000","last_undegraded":"2024-09-19T07:07:15.060781+0000","last_fullsized":"2024-09-19T07:07:15.060781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059299+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:07:15.059299+0000","last_peered":"2024-09-19T07:07:15.059299+0000","last_clean":"2024-09-19T07:07:15.059299+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:07:15.059299+0000","last_undegraded":"2024-09-19T07:07:15.059299+0000","last_fullsized":"2024-09-19T07:07:15.059299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067493+0000","last_change":"2024-09-19T07:07:15.066954+0000","last_active":"2024-09-19T07:07:15.067493+0000","last_peered":"2024-09-19T07:07:15.067493+0000","last_clean":"2024-09-19T07:07:15.067493+0000","last_became_active":"2024-09-19T07:07:15.066612+0000","last_became_peered":"2024-09-19T07:07:15.066612+0000","last_unstale":"2024-09-19T07:07:15.067493+0000","last_undegraded":"2024-09-19T07:07:15.067493+0000","last_fullsized":"2024-09-19T07:07:15.067493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:26.150407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060948+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:07:15.060948+0000","last_peered":"2024-09-19T07:07:15.060948+0000","last_clean":"2024-09-19T07:07:15.060948+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:07:15.060948+0000","last_undegraded":"2024-09-19T07:07:15.060948+0000","last_fullsized":"2024-09-19T07:07:15.060948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064344+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:07:15.064344+0000","last_peered":"2024-09-19T07:07:15.064344+0000","last_clean":"2024-09-19T07:07:15.064344+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:07:15.064344+0000","last_undegraded":"2024-09-19T07:07:15.064344+0000","last_fullsized":"2024-09-19T07:07:15.064344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059936+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:07:15.059936+0000","last_peered":"2024-09-19T07:07:15.059936+0000","last_clean":"2024-09-19T07:07:15.059936+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:07:15.059936+0000","last_undegraded":"2024-09-19T07:07:15.059936+0000","last_fullsized":"2024-09-19T07:07:15.059936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067359+0000","last_change":"2024-09-19T07:07:15.067359+0000","last_active":"2024-09-19T07:07:15.067359+0000","last_peered":"2024-09-19T07:07:15.067359+0000","last_clean":"2024-09-19T07:07:15.067359+0000","last_became_active":"2024-09-19T07:07:15.066885+0000","last_became_peered":"2024-09-19T07:07:15.066885+0000","last_unstale":"2024-09-19T07:07:15.067359+0000","last_undegraded":"2024-09-19T07:07:15.067359+0000","last_fullsized":"2024-09-19T07:07:15.067359+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:35.148606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059417+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:07:15.059417+0000","last_peered":"2024-09-19T07:07:15.059417+0000","last_clean":"2024-09-19T07:07:15.059417+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:07:15.059417+0000","last_undegraded":"2024-09-19T07:07:15.059417+0000","last_fullsized":"2024-09-19T07:07:15.059417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086017+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:15.086017+0000","last_peered":"2024-09-19T07:07:15.086017+0000","last_clean":"2024-09-19T07:07:15.086017+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:15.086017+0000","last_undegraded":"2024-09-19T07:07:15.086017+0000","last_fullsized":"2024-09-19T07:07:15.086017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060778+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:07:15.060778+0000","last_peered":"2024-09-19T07:07:15.060778+0000","last_clean":"2024-09-19T07:07:15.060778+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:07:15.060778+0000","last_undegraded":"2024-09-19T07:07:15.060778+0000","last_fullsized":"2024-09-19T07:07:15.060778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178074+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:15.178074+0000","last_peered":"2024-09-19T07:07:15.178074+0000","last_clean":"2024-09-19T07:07:15.178074+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:15.178074+0000","last_undegraded":"2024-09-19T07:07:15.178074+0000","last_fullsized":"2024-09-19T07:07:15.178074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061553+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:07:15.061553+0000","last_peered":"2024-09-19T07:07:15.061553+0000","last_clean":"2024-09-19T07:07:15.061553+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:07:15.061553+0000","last_undegraded":"2024-09-19T07:07:15.061553+0000","last_fullsized":"2024-09-19T07:07:15.061553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060645+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:07:15.060645+0000","last_peered":"2024-09-19T07:07:15.060645+0000","last_clean":"2024-09-19T07:07:15.060645+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:07:15.060645+0000","last_undegraded":"2024-09-19T07:07:15.060645+0000","last_fullsized":"2024-09-19T07:07:15.060645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060984+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:15.060984+0000","last_peered":"2024-09-19T07:07:15.060984+0000","last_clean":"2024-09-19T07:07:15.060984+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:15.060984+0000","last_undegraded":"2024-09-19T07:07:15.060984+0000","last_fullsized":"2024-09-19T07:07:15.060984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058971+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:07:15.058971+0000","last_peered":"2024-09-19T07:07:15.058971+0000","last_clean":"2024-09-19T07:07:15.058971+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:07:15.058971+0000","last_undegraded":"2024-09-19T07:07:15.058971+0000","last_fullsized":"2024-09-19T07:07:15.058971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057010+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:15.057010+0000","last_peered":"2024-09-19T07:07:15.057010+0000","last_clean":"2024-09-19T07:07:15.057010+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:15.057010+0000","last_undegraded":"2024-09-19T07:07:15.057010+0000","last_fullsized":"2024-09-19T07:07:15.057010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064970+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:07:15.064970+0000","last_peered":"2024-09-19T07:07:15.064970+0000","last_clean":"2024-09-19T07:07:15.064970+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:07:15.064970+0000","last_undegraded":"2024-09-19T07:07:15.064970+0000","last_fullsized":"2024-09-19T07:07:15.064970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062074+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:07:15.062074+0000","last_peered":"2024-09-19T07:07:15.062074+0000","last_clean":"2024-09-19T07:07:15.062074+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:07:15.062074+0000","last_undegraded":"2024-09-19T07:07:15.062074+0000","last_fullsized":"2024-09-19T07:07:15.062074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061661+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:07:15.061661+0000","last_peered":"2024-09-19T07:07:15.061661+0000","last_clean":"2024-09-19T07:07:15.061661+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:07:15.061661+0000","last_undegraded":"2024-09-19T07:07:15.061661+0000","last_fullsized":"2024-09-19T07:07:15.061661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060362+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:07:15.060362+0000","last_peered":"2024-09-19T07:07:15.060362+0000","last_clean":"2024-09-19T07:07:15.060362+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:07:15.060362+0000","last_undegraded":"2024-09-19T07:07:15.060362+0000","last_fullsized":"2024-09-19T07:07:15.060362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062221+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:07:15.062221+0000","last_peered":"2024-09-19T07:07:15.062221+0000","last_clean":"2024-09-19T07:07:15.062221+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:07:15.062221+0000","last_undegraded":"2024-09-19T07:07:15.062221+0000","last_fullsized":"2024-09-19T07:07:15.062221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062339+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:07:15.062339+0000","last_peered":"2024-09-19T07:07:15.062339+0000","last_clean":"2024-09-19T07:07:15.062339+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:07:15.062339+0000","last_undegraded":"2024-09-19T07:07:15.062339+0000","last_fullsized":"2024-09-19T07:07:15.062339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056887+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:15.056887+0000","last_peered":"2024-09-19T07:07:15.056887+0000","last_clean":"2024-09-19T07:07:15.056887+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:15.056887+0000","last_undegraded":"2024-09-19T07:07:15.056887+0000","last_fullsized":"2024-09-19T07:07:15.056887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057741+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:15.057741+0000","last_peered":"2024-09-19T07:07:15.057741+0000","last_clean":"2024-09-19T07:07:15.057741+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:15.057741+0000","last_undegraded":"2024-09-19T07:07:15.057741+0000","last_fullsized":"2024-09-19T07:07:15.057741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056666+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:15.056666+0000","last_peered":"2024-09-19T07:07:15.056666+0000","last_clean":"2024-09-19T07:07:15.056666+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:15.056666+0000","last_undegraded":"2024-09-19T07:07:15.056666+0000","last_fullsized":"2024-09-19T07:07:15.056666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057025+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:15.057025+0000","last_peered":"2024-09-19T07:07:15.057025+0000","last_clean":"2024-09-19T07:07:15.057025+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:15.057025+0000","last_undegraded":"2024-09-19T07:07:15.057025+0000","last_fullsized":"2024-09-19T07:07:15.057025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056535+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:15.056535+0000","last_peered":"2024-09-19T07:07:15.056535+0000","last_clean":"2024-09-19T07:07:15.056535+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.056535+0000","last_undegraded":"2024-09-19T07:07:15.056535+0000","last_fullsized":"2024-09-19T07:07:15.056535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058690+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:15.058690+0000","last_peered":"2024-09-19T07:07:15.058690+0000","last_clean":"2024-09-19T07:07:15.058690+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:15.058690+0000","last_undegraded":"2024-09-19T07:07:15.058690+0000","last_fullsized":"2024-09-19T07:07:15.058690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059640+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:07:15.059640+0000","last_peered":"2024-09-19T07:07:15.059640+0000","last_clean":"2024-09-19T07:07:15.059640+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:07:15.059640+0000","last_undegraded":"2024-09-19T07:07:15.059640+0000","last_fullsized":"2024-09-19T07:07:15.059640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061668+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:07:15.061668+0000","last_peered":"2024-09-19T07:07:15.061668+0000","last_clean":"2024-09-19T07:07:15.061668+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:07:15.061668+0000","last_undegraded":"2024-09-19T07:07:15.061668+0000","last_fullsized":"2024-09-19T07:07:15.061668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057575+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057575+0000","last_peered":"2024-09-19T07:07:15.057575+0000","last_clean":"2024-09-19T07:07:15.057575+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057575+0000","last_undegraded":"2024-09-19T07:07:15.057575+0000","last_fullsized":"2024-09-19T07:07:15.057575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086015+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:15.086015+0000","last_peered":"2024-09-19T07:07:15.086015+0000","last_clean":"2024-09-19T07:07:15.086015+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:15.086015+0000","last_undegraded":"2024-09-19T07:07:15.086015+0000","last_fullsized":"2024-09-19T07:07:15.086015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058713+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:15.058713+0000","last_peered":"2024-09-19T07:07:15.058713+0000","last_clean":"2024-09-19T07:07:15.058713+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:15.058713+0000","last_undegraded":"2024-09-19T07:07:15.058713+0000","last_fullsized":"2024-09-19T07:07:15.058713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177840+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:15.177840+0000","last_peered":"2024-09-19T07:07:15.177840+0000","last_clean":"2024-09-19T07:07:15.177840+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:15.177840+0000","last_undegraded":"2024-09-19T07:07:15.177840+0000","last_fullsized":"2024-09-19T07:07:15.177840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067483+0000","last_change":"2024-09-19T07:07:15.067483+0000","last_active":"2024-09-19T07:07:15.067483+0000","last_peered":"2024-09-19T07:07:15.067483+0000","last_clean":"2024-09-19T07:07:15.067483+0000","last_became_active":"2024-09-19T07:07:15.064076+0000","last_became_peered":"2024-09-19T07:07:15.064076+0000","last_unstale":"2024-09-19T07:07:15.067483+0000","last_undegraded":"2024-09-19T07:07:15.067483+0000","last_fullsized":"2024-09-19T07:07:15.067483+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:42.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057614+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:15.057614+0000","last_peered":"2024-09-19T07:07:15.057614+0000","last_clean":"2024-09-19T07:07:15.057614+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:15.057614+0000","last_undegraded":"2024-09-19T07:07:15.057614+0000","last_fullsized":"2024-09-19T07:07:15.057614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063452+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:07:15.063452+0000","last_peered":"2024-09-19T07:07:15.063452+0000","last_clean":"2024-09-19T07:07:15.063452+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:07:15.063452+0000","last_undegraded":"2024-09-19T07:07:15.063452+0000","last_fullsized":"2024-09-19T07:07:15.063452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.070425+0000","last_change":"2024-09-19T07:07:15.069990+0000","last_active":"2024-09-19T07:07:15.070425+0000","last_peered":"2024-09-19T07:07:15.070425+0000","last_clean":"2024-09-19T07:07:15.070425+0000","last_became_active":"2024-09-19T07:07:15.064494+0000","last_became_peered":"2024-09-19T07:07:15.064494+0000","last_unstale":"2024-09-19T07:07:15.070425+0000","last_undegraded":"2024-09-19T07:07:15.070425+0000","last_fullsized":"2024-09-19T07:07:15.070425+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:45.233325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057683+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:15.057683+0000","last_peered":"2024-09-19T07:07:15.057683+0000","last_clean":"2024-09-19T07:07:15.057683+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:15.057683+0000","last_undegraded":"2024-09-19T07:07:15.057683+0000","last_fullsized":"2024-09-19T07:07:15.057683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057775+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:15.057775+0000","last_peered":"2024-09-19T07:07:15.057775+0000","last_clean":"2024-09-19T07:07:15.057775+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:15.057775+0000","last_undegraded":"2024-09-19T07:07:15.057775+0000","last_fullsized":"2024-09-19T07:07:15.057775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062951+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:07:15.062951+0000","last_peered":"2024-09-19T07:07:15.062951+0000","last_clean":"2024-09-19T07:07:15.062951+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:07:15.062951+0000","last_undegraded":"2024-09-19T07:07:15.062951+0000","last_fullsized":"2024-09-19T07:07:15.062951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057175+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:15.057175+0000","last_peered":"2024-09-19T07:07:15.057175+0000","last_clean":"2024-09-19T07:07:15.057175+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:15.057175+0000","last_undegraded":"2024-09-19T07:07:15.057175+0000","last_fullsized":"2024-09-19T07:07:15.057175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060703+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:07:15.060703+0000","last_peered":"2024-09-19T07:07:15.060703+0000","last_clean":"2024-09-19T07:07:15.060703+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:07:15.060703+0000","last_undegraded":"2024-09-19T07:07:15.060703+0000","last_fullsized":"2024-09-19T07:07:15.060703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061227+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:07:15.061227+0000","last_peered":"2024-09-19T07:07:15.061227+0000","last_clean":"2024-09-19T07:07:15.061227+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:07:15.061227+0000","last_undegraded":"2024-09-19T07:07:15.061227+0000","last_fullsized":"2024-09-19T07:07:15.061227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057997+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:15.057997+0000","last_peered":"2024-09-19T07:07:15.057997+0000","last_clean":"2024-09-19T07:07:15.057997+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:15.057997+0000","last_undegraded":"2024-09-19T07:07:15.057997+0000","last_fullsized":"2024-09-19T07:07:15.057997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062190+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:07:15.062190+0000","last_peered":"2024-09-19T07:07:15.062190+0000","last_clean":"2024-09-19T07:07:15.062190+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:07:15.062190+0000","last_undegraded":"2024-09-19T07:07:15.062190+0000","last_fullsized":"2024-09-19T07:07:15.062190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056695+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:15.056695+0000","last_peered":"2024-09-19T07:07:15.056695+0000","last_clean":"2024-09-19T07:07:15.056695+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:15.056695+0000","last_undegraded":"2024-09-19T07:07:15.056695+0000","last_fullsized":"2024-09-19T07:07:15.056695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058263+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:15.058263+0000","last_peered":"2024-09-19T07:07:15.058263+0000","last_clean":"2024-09-19T07:07:15.058263+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:15.058263+0000","last_undegraded":"2024-09-19T07:07:15.058263+0000","last_fullsized":"2024-09-19T07:07:15.058263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064712+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:07:15.064712+0000","last_peered":"2024-09-19T07:07:15.064712+0000","last_clean":"2024-09-19T07:07:15.064712+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:07:15.064712+0000","last_undegraded":"2024-09-19T07:07:15.064712+0000","last_fullsized":"2024-09-19T07:07:15.064712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'28","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:17.043862+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:07:17.043862+0000","last_peered":"2024-09-19T07:07:17.043862+0000","last_clean":"2024-09-19T07:07:17.043862+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:07:17.043862+0000","last_undegraded":"2024-09-19T07:07:17.043862+0000","last_fullsized":"2024-09-19T07:07:17.043862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59246,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":78,"num_write":28,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060105+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:07:15.060105+0000","last_peered":"2024-09-19T07:07:15.060105+0000","last_clean":"2024-09-19T07:07:15.060105+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:07:15.060105+0000","last_undegraded":"2024-09-19T07:07:15.060105+0000","last_fullsized":"2024-09-19T07:07:15.060105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086241+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:15.086241+0000","last_peered":"2024-09-19T07:07:15.086241+0000","last_clean":"2024-09-19T07:07:15.086241+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.086241+0000","last_undegraded":"2024-09-19T07:07:15.086241+0000","last_fullsized":"2024-09-19T07:07:15.086241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058608+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:15.058608+0000","last_peered":"2024-09-19T07:07:15.058608+0000","last_clean":"2024-09-19T07:07:15.058608+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:15.058608+0000","last_undegraded":"2024-09-19T07:07:15.058608+0000","last_fullsized":"2024-09-19T07:07:15.058608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061390+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:07:15.061390+0000","last_peered":"2024-09-19T07:07:15.061390+0000","last_clean":"2024-09-19T07:07:15.061390+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:07:15.061390+0000","last_undegraded":"2024-09-19T07:07:15.061390+0000","last_fullsized":"2024-09-19T07:07:15.061390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178243+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:15.178243+0000","last_peered":"2024-09-19T07:07:15.178243+0000","last_clean":"2024-09-19T07:07:15.178243+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:15.178243+0000","last_undegraded":"2024-09-19T07:07:15.178243+0000","last_fullsized":"2024-09-19T07:07:15.178243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059369+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:07:15.059369+0000","last_peered":"2024-09-19T07:07:15.059369+0000","last_clean":"2024-09-19T07:07:15.059369+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:07:15.059369+0000","last_undegraded":"2024-09-19T07:07:15.059369+0000","last_fullsized":"2024-09-19T07:07:15.059369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086511+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:15.086511+0000","last_peered":"2024-09-19T07:07:15.086511+0000","last_clean":"2024-09-19T07:07:15.086511+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:15.086511+0000","last_undegraded":"2024-09-19T07:07:15.086511+0000","last_fullsized":"2024-09-19T07:07:15.086511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062233+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:07:15.062233+0000","last_peered":"2024-09-19T07:07:15.062233+0000","last_clean":"2024-09-19T07:07:15.062233+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:07:15.062233+0000","last_undegraded":"2024-09-19T07:07:15.062233+0000","last_fullsized":"2024-09-19T07:07:15.062233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059669+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:07:15.059669+0000","last_peered":"2024-09-19T07:07:15.059669+0000","last_clean":"2024-09-19T07:07:15.059669+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:07:15.059669+0000","last_undegraded":"2024-09-19T07:07:15.059669+0000","last_fullsized":"2024-09-19T07:07:15.059669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177946+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:15.177946+0000","last_peered":"2024-09-19T07:07:15.177946+0000","last_clean":"2024-09-19T07:07:15.177946+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:15.177946+0000","last_undegraded":"2024-09-19T07:07:15.177946+0000","last_fullsized":"2024-09-19T07:07:15.177946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059855+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:07:15.059855+0000","last_peered":"2024-09-19T07:07:15.059855+0000","last_clean":"2024-09-19T07:07:15.059855+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:07:15.059855+0000","last_undegraded":"2024-09-19T07:07:15.059855+0000","last_fullsized":"2024-09-19T07:07:15.059855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057987+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:15.057987+0000","last_peered":"2024-09-19T07:07:15.057987+0000","last_clean":"2024-09-19T07:07:15.057987+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:15.057987+0000","last_undegraded":"2024-09-19T07:07:15.057987+0000","last_fullsized":"2024-09-19T07:07:15.057987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179142+0000","last_change":"2024-09-19T07:07:15.179142+0000","last_active":"2024-09-19T07:07:15.179142+0000","last_peered":"2024-09-19T07:07:15.179142+0000","last_clean":"2024-09-19T07:07:15.179142+0000","last_became_active":"2024-09-19T07:07:15.178586+0000","last_became_peered":"2024-09-19T07:07:15.178586+0000","last_unstale":"2024-09-19T07:07:15.179142+0000","last_undegraded":"2024-09-19T07:07:15.179142+0000","last_fullsized":"2024-09-19T07:07:15.179142+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:24.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059113+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:07:15.059113+0000","last_peered":"2024-09-19T07:07:15.059113+0000","last_clean":"2024-09-19T07:07:15.059113+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:07:15.059113+0000","last_undegraded":"2024-09-19T07:07:15.059113+0000","last_fullsized":"2024-09-19T07:07:15.059113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056560+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:15.056560+0000","last_peered":"2024-09-19T07:07:15.056560+0000","last_clean":"2024-09-19T07:07:15.056560+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:15.056560+0000","last_undegraded":"2024-09-19T07:07:15.056560+0000","last_fullsized":"2024-09-19T07:07:15.056560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061522+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:07:15.061522+0000","last_peered":"2024-09-19T07:07:15.061522+0000","last_clean":"2024-09-19T07:07:15.061522+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:07:15.061522+0000","last_undegraded":"2024-09-19T07:07:15.061522+0000","last_fullsized":"2024-09-19T07:07:15.061522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058324+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:15.058324+0000","last_peered":"2024-09-19T07:07:15.058324+0000","last_clean":"2024-09-19T07:07:15.058324+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:15.058324+0000","last_undegraded":"2024-09-19T07:07:15.058324+0000","last_fullsized":"2024-09-19T07:07:15.058324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058457+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:15.058457+0000","last_peered":"2024-09-19T07:07:15.058457+0000","last_clean":"2024-09-19T07:07:15.058457+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:15.058457+0000","last_undegraded":"2024-09-19T07:07:15.058457+0000","last_fullsized":"2024-09-19T07:07:15.058457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062435+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:07:15.062435+0000","last_peered":"2024-09-19T07:07:15.062435+0000","last_clean":"2024-09-19T07:07:15.062435+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:07:15.062435+0000","last_undegraded":"2024-09-19T07:07:15.062435+0000","last_fullsized":"2024-09-19T07:07:15.062435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064296+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:07:15.064296+0000","last_peered":"2024-09-19T07:07:15.064296+0000","last_clean":"2024-09-19T07:07:15.064296+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:07:15.064296+0000","last_undegraded":"2024-09-19T07:07:15.064296+0000","last_fullsized":"2024-09-19T07:07:15.064296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177982+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:15.177982+0000","last_peered":"2024-09-19T07:07:15.177982+0000","last_clean":"2024-09-19T07:07:15.177982+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:15.177982+0000","last_undegraded":"2024-09-19T07:07:15.177982+0000","last_fullsized":"2024-09-19T07:07:15.177982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057006+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:15.057006+0000","last_peered":"2024-09-19T07:07:15.057006+0000","last_clean":"2024-09-19T07:07:15.057006+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:15.057006+0000","last_undegraded":"2024-09-19T07:07:15.057006+0000","last_fullsized":"2024-09-19T07:07:15.057006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063399+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:07:15.063399+0000","last_peered":"2024-09-19T07:07:15.063399+0000","last_clean":"2024-09-19T07:07:15.063399+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:07:15.063399+0000","last_undegraded":"2024-09-19T07:07:15.063399+0000","last_fullsized":"2024-09-19T07:07:15.063399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057769+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:15.057769+0000","last_peered":"2024-09-19T07:07:15.057769+0000","last_clean":"2024-09-19T07:07:15.057769+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:15.057769+0000","last_undegraded":"2024-09-19T07:07:15.057769+0000","last_fullsized":"2024-09-19T07:07:15.057769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059836+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:07:15.059836+0000","last_peered":"2024-09-19T07:07:15.059836+0000","last_clean":"2024-09-19T07:07:15.059836+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:07:15.059836+0000","last_undegraded":"2024-09-19T07:07:15.059836+0000","last_fullsized":"2024-09-19T07:07:15.059836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086193+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:15.086193+0000","last_peered":"2024-09-19T07:07:15.086193+0000","last_clean":"2024-09-19T07:07:15.086193+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:15.086193+0000","last_undegraded":"2024-09-19T07:07:15.086193+0000","last_fullsized":"2024-09-19T07:07:15.086193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056901+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:15.056901+0000","last_peered":"2024-09-19T07:07:15.056901+0000","last_clean":"2024-09-19T07:07:15.056901+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:15.056901+0000","last_undegraded":"2024-09-19T07:07:15.056901+0000","last_fullsized":"2024-09-19T07:07:15.056901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061870+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:07:15.061870+0000","last_peered":"2024-09-19T07:07:15.061870+0000","last_clean":"2024-09-19T07:07:15.061870+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:07:15.061870+0000","last_undegraded":"2024-09-19T07:07:15.061870+0000","last_fullsized":"2024-09-19T07:07:15.061870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060878+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:07:15.060878+0000","last_peered":"2024-09-19T07:07:15.060878+0000","last_clean":"2024-09-19T07:07:15.060878+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:07:15.060878+0000","last_undegraded":"2024-09-19T07:07:15.060878+0000","last_fullsized":"2024-09-19T07:07:15.060878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063278+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:07:15.063278+0000","last_peered":"2024-09-19T07:07:15.063278+0000","last_clean":"2024-09-19T07:07:15.063278+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:07:15.063278+0000","last_undegraded":"2024-09-19T07:07:15.063278+0000","last_fullsized":"2024-09-19T07:07:15.063278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.085854+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:15.085854+0000","last_peered":"2024-09-19T07:07:15.085854+0000","last_clean":"2024-09-19T07:07:15.085854+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:15.085854+0000","last_undegraded":"2024-09-19T07:07:15.085854+0000","last_fullsized":"2024-09-19T07:07:15.085854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177830+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:15.177830+0000","last_peered":"2024-09-19T07:07:15.177830+0000","last_clean":"2024-09-19T07:07:15.177830+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:15.177830+0000","last_undegraded":"2024-09-19T07:07:15.177830+0000","last_fullsized":"2024-09-19T07:07:15.177830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177571+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:15.177571+0000","last_peered":"2024-09-19T07:07:15.177571+0000","last_clean":"2024-09-19T07:07:15.177571+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:15.177571+0000","last_undegraded":"2024-09-19T07:07:15.177571+0000","last_fullsized":"2024-09-19T07:07:15.177571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056875+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:15.056875+0000","last_peered":"2024-09-19T07:07:15.056875+0000","last_clean":"2024-09-19T07:07:15.056875+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:15.056875+0000","last_undegraded":"2024-09-19T07:07:15.056875+0000","last_fullsized":"2024-09-19T07:07:15.056875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061384+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:07:15.061384+0000","last_peered":"2024-09-19T07:07:15.061384+0000","last_clean":"2024-09-19T07:07:15.061384+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:07:15.061384+0000","last_undegraded":"2024-09-19T07:07:15.061384+0000","last_fullsized":"2024-09-19T07:07:15.061384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067182+0000","last_change":"2024-09-19T07:07:15.067182+0000","last_active":"2024-09-19T07:07:15.067182+0000","last_peered":"2024-09-19T07:07:15.067182+0000","last_clean":"2024-09-19T07:07:15.067182+0000","last_became_active":"2024-09-19T07:07:15.066805+0000","last_became_peered":"2024-09-19T07:07:15.066805+0000","last_unstale":"2024-09-19T07:07:15.067182+0000","last_undegraded":"2024-09-19T07:07:15.067182+0000","last_fullsized":"2024-09-19T07:07:15.067182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:05.606025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086686+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:15.086686+0000","last_peered":"2024-09-19T07:07:15.086686+0000","last_clean":"2024-09-19T07:07:15.086686+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:15.086686+0000","last_undegraded":"2024-09-19T07:07:15.086686+0000","last_fullsized":"2024-09-19T07:07:15.086686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059089+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:07:15.059089+0000","last_peered":"2024-09-19T07:07:15.059089+0000","last_clean":"2024-09-19T07:07:15.059089+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:07:15.059089+0000","last_undegraded":"2024-09-19T07:07:15.059089+0000","last_fullsized":"2024-09-19T07:07:15.059089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061406+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:07:15.061406+0000","last_peered":"2024-09-19T07:07:15.061406+0000","last_clean":"2024-09-19T07:07:15.061406+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:07:15.061406+0000","last_undegraded":"2024-09-19T07:07:15.061406+0000","last_fullsized":"2024-09-19T07:07:15.061406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064389+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:07:15.064389+0000","last_peered":"2024-09-19T07:07:15.064389+0000","last_clean":"2024-09-19T07:07:15.064389+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:07:15.064389+0000","last_undegraded":"2024-09-19T07:07:15.064389+0000","last_fullsized":"2024-09-19T07:07:15.064389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061304+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:07:15.061304+0000","last_peered":"2024-09-19T07:07:15.061304+0000","last_clean":"2024-09-19T07:07:15.061304+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:07:15.061304+0000","last_undegraded":"2024-09-19T07:07:15.061304+0000","last_fullsized":"2024-09-19T07:07:15.061304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177882+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:15.177882+0000","last_peered":"2024-09-19T07:07:15.177882+0000","last_clean":"2024-09-19T07:07:15.177882+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:15.177882+0000","last_undegraded":"2024-09-19T07:07:15.177882+0000","last_fullsized":"2024-09-19T07:07:15.177882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178041+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:15.178041+0000","last_peered":"2024-09-19T07:07:15.178041+0000","last_clean":"2024-09-19T07:07:15.178041+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:15.178041+0000","last_undegraded":"2024-09-19T07:07:15.178041+0000","last_fullsized":"2024-09-19T07:07:15.178041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062462+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:07:15.062462+0000","last_peered":"2024-09-19T07:07:15.062462+0000","last_clean":"2024-09-19T07:07:15.062462+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:07:15.062462+0000","last_undegraded":"2024-09-19T07:07:15.062462+0000","last_fullsized":"2024-09-19T07:07:15.062462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60044,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":46,"num_read_kb":83,"num_write":81,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":180132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":68,"ondisk_log_size":68,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514520,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743452,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1687552,"data_stored":1150335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906976,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1024000,"data_stored":509301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":504623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561073,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1622016,"data_stored":1095173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":500631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":559807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1085440,"data_stored":560355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1015808,"data_stored":500617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:07:20.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph status --format=json 2024-09-19T07:07:21.024 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:21.340 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:21 smithi046 ceph-mon[34147]: pgmap v323: 129 pgs: 129 active+clean; 635 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 KiB/s wr, 4 op/s; 75 B/s, 0 objects/s recovering 2024-09-19T07:07:21.340 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:21 smithi046 ceph-mon[34147]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:21.340 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:21 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:21.344 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:21 smithi078 ceph-mon[34556]: pgmap v323: 129 pgs: 129 active+clean; 635 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 KiB/s wr, 4 op/s; 75 B/s, 0 objects/s recovering 2024-09-19T07:07:21.344 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:21 smithi078 ceph-mon[34556]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:21.344 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:21 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:21.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:21 smithi029 ceph-mon[31255]: pgmap v323: 129 pgs: 129 active+clean; 635 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 5.0 KiB/s wr, 4 op/s; 75 B/s, 0 objects/s recovering 2024-09-19T07:07:21.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:21 smithi029 ceph-mon[31255]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:21.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:21 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 -- 172.21.15.29:0/3777240850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 msgr2=0x7fac2410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 --2- 172.21.15.29:0/3777240850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac2410bbb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fac14009900 tx=0x7fac1402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 -- 172.21.15.29:0/3777240850 shutdown_connections 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 --2- 172.21.15.29:0/3777240850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac2410c180 0x7fac2410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 --2- 172.21.15.29:0/3777240850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac2410bbb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 --2- 172.21.15.29:0/3777240850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac24102da0 0x7fac24103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 -- 172.21.15.29:0/3777240850 >> 172.21.15.29:0/3777240850 conn(0x7fac240fc7a0 msgr2=0x7fac240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 -- 172.21.15.29:0/3777240850 shutdown_connections 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.499+0000 7fac2b747640 1 -- 172.21.15.29:0/3777240850 wait complete. 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 Processor -- start 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 -- start start 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac24102da0 0x7fac24100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac24100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac2410c180 0x7fac24101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fac24111e10 con 0x7fac241036c0 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fac24111c90 con 0x7fac24102da0 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac2b747640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fac24111f90 con 0x7fac2410c180 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.500+0000 7fac28ce2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac24100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:21.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac24100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52688/0 (socket says 172.21.15.29:52688) 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 -- 172.21.15.29:0/870219025 learned_addr learned my addr 172.21.15.29:0/870219025 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac294e3640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac24102da0 0x7fac24100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac29ce4640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac2410c180 0x7fac24101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 -- 172.21.15.29:0/870219025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac2410c180 msgr2=0x7fac24101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac2410c180 0x7fac24101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 -- 172.21.15.29:0/870219025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac24102da0 msgr2=0x7fac24100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac24102da0 0x7fac24100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 -- 172.21.15.29:0/870219025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac241a6850 con 0x7fac241036c0 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac29ce4640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac2410c180 0x7fac24101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac28ce2640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac24100f40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac14005940 tx=0x7fac14004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:21.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1403f030 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac14003aa0 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac241a6ae0 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14035070 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.501+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac241a7010 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.502+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac24103180 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.504+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac14042030 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.504+0000 7fac1a7fc640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fac100a3350 0x7fac100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.504+0000 7fac294e3640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fac100a3350 0x7fac100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.504+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fac140f0720 con 0x7fac241036c0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.505+0000 7fac294e3640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fac100a3350 0x7fac100a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac20005d00 tx=0x7fac2000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:21.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.508+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac140bcf80 con 0x7fac241036c0 2024-09-19T07:07:21.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.760+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fac24101f30 con 0x7fac241036c0 2024-09-19T07:07:21.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.760+0000 7fac1a7fc640 1 -- 172.21.15.29:0/870219025 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1685 (secure 0 0 0) 0x7fac24101f30 con 0x7fac241036c0 2024-09-19T07:07:21.762 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:21.762 INFO:teuthology.orchestra.run.smithi029.stdout:{"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":440,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":90,"num_osds":12,"num_up_osds":12,"osd_up_since":1726729533,"num_in_osds":12,"osd_in_since":1726729509,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129}],"num_pgs":129,"num_pools":4,"num_objects":26,"data_bytes":650646,"bytes_used":414535680,"bytes_avail":1151525892096,"bytes_total":1151940427776,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":75,"recovering_keys_per_sec":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"read_bytes_sec":5630,"write_bytes_sec":5118,"read_op_per_sec":2,"write_op_per_sec":2},"fsmap":{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:standby-replay","gid":24488},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24499}],"up:standby":10},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.29:8443/"}},"servicemap":{"epoch":28,"modified":"2024-09-19T07:07:13.853912+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T07:07:21.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.763+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fac100a3350 msgr2=0x7fac100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:21.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.763+0000 7fac2b747640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fac100a3350 0x7fac100a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac20005d00 tx=0x7fac2000b410 comp rx=0 tx=0).stop 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.763+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 msgr2=0x7fac24100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.763+0000 7fac2b747640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac24100f40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac14005940 tx=0x7fac14004270 comp rx=0 tx=0).stop 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 shutdown_connections 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fac100a3350 0x7fac100a5810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac2410c180 0x7fac24101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fac241036c0 0x7fac24100f40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 --2- 172.21.15.29:0/870219025 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac24102da0 0x7fac24100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 >> 172.21.15.29:0/870219025 conn(0x7fac240fc7a0 msgr2=0x7fac240fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 shutdown_connections 2024-09-19T07:07:21.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:21.764+0000 7fac2b747640 1 -- 172.21.15.29:0/870219025 wait complete. 2024-09-19T07:07:22.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:22 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/870219025' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T07:07:22.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:22 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/870219025' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T07:07:22.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:22 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/870219025' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T07:07:22.597 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-19T07:07:22.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:07:22.988 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:23 smithi029 ceph-mon[31255]: pgmap v324: 129 pgs: 129 active+clean; 635 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 2 op/s; 75 B/s, 0 objects/s recovering 2024-09-19T07:07:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:23 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:23 smithi078 ceph-mon[34556]: pgmap v324: 129 pgs: 129 active+clean; 635 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 2 op/s; 75 B/s, 0 objects/s recovering 2024-09-19T07:07:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:23 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:23 smithi046 ceph-mon[34147]: pgmap v324: 129 pgs: 129 active+clean; 635 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 2 op/s; 75 B/s, 0 objects/s recovering 2024-09-19T07:07:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:23 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:23.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 -- 172.21.15.29:0/714135169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102570 msgr2=0x7fc0841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:23.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/714135169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102570 0x7fc0841029b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc074009900 tx=0x7fc07402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:23.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 -- 172.21.15.29:0/714135169 shutdown_connections 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/714135169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc084102ef0 0x7fc08410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/714135169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102570 0x7fc0841029b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/714135169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 0x7fc084101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 -- 172.21.15.29:0/714135169 >> 172.21.15.29:0/714135169 conn(0x7fc0840fc7d0 msgr2=0x7fc0840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 -- 172.21.15.29:0/714135169 shutdown_connections 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.464+0000 7fc08ba2b640 1 -- 172.21.15.29:0/714135169 wait complete. 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 Processor -- start 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 -- start start 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 0x7fc084197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc084102570 0x7fc0841977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 0x7fc08419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc084110e30 con 0x7fc084102ef0 2024-09-19T07:07:23.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc084110cb0 con 0x7fc084102570 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc08ba2b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc084110fb0 con 0x7fc084100e20 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 0x7fc08419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 0x7fc08419bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52694/0 (socket says 172.21.15.29:52694) 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 -- 172.21.15.29:0/1995909050 learned_addr learned my addr 172.21.15.29:0/1995909050 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc088fc6640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc084102570 0x7fc0841977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc0897c7640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 0x7fc084197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 -- 172.21.15.29:0/1995909050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 msgr2=0x7fc084197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 0x7fc084197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 -- 172.21.15.29:0/1995909050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc084102570 msgr2=0x7fc0841977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc084102570 0x7fc0841977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc089fc8640 1 -- 172.21.15.29:0/1995909050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08419c220 con 0x7fc084102ef0 2024-09-19T07:07:23.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.465+0000 7fc0897c7640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 0x7fc084197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.466+0000 7fc089fc8640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 0x7fc08419bb40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00cce0 tx=0x7fc07c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.466+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00f450 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.466+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc07c00faa0 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.466+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08419c510 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.466+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c018b70 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.466+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0841a3df0 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.467+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc084101200 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.468+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc07c018d10 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.469+0000 7fc07a7fc640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0700a3350 0x7fc0700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.469+0000 7fc0897c7640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0700a3350 0x7fc0700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.469+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fc07c0d02b0 con 0x7fc084102ef0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.469+0000 7fc0897c7640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0700a3350 0x7fc0700a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc080005d00 tx=0x7fc080005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:23.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.472+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc07c014030 con 0x7fc084102ef0 2024-09-19T07:07:23.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.669+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0841090c0 con 0x7fc0700a3350 2024-09-19T07:07:23.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.680+0000 7fc07a7fc640 1 -- 172.21.15.29:0/1995909050 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340292 (secure 0 0 0) 0x7fc0841090c0 con 0x7fc0700a3350 2024-09-19T07:07:23.683 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:23.685 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:07:23.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0700a3350 msgr2=0x7fc0700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:23.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0700a3350 0x7fc0700a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc080005d00 tx=0x7fc080005ed0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 msgr2=0x7fc08419bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:23.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 0x7fc08419bb40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00cce0 tx=0x7fc07c00a620 comp rx=0 tx=0).stop 2024-09-19T07:07:23.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 shutdown_connections 2024-09-19T07:07:23.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc084102ef0 0x7fc08419bb40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc084102570 0x7fc0841977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc0700a3350 0x7fc0700a5810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 --2- 172.21.15.29:0/1995909050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc084100e20 0x7fc084197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:23.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 >> 172.21.15.29:0/1995909050 conn(0x7fc0840fc7d0 msgr2=0x7fc0840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:23.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 shutdown_connections 2024-09-19T07:07:23.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:23.683+0000 7fc08ba2b640 1 -- 172.21.15.29:0/1995909050 wait complete. 2024-09-19T07:07:24.430 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:24 smithi029 ceph-mon[31255]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:24.460 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-19T07:07:21.855597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650646,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":172,"num_read_kb":192,"num_write":266,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181340,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404820,"kb_used_data":13892,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537004,"statfs":{"total":1151940427776,"available":1151525892096,"internally_reserved":0,"allocated":14225408,"data_stored":7990328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10148,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":12,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001820"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.091196+0000","last_change":"2024-09-19T07:07:15.091196+0000","last_active":"2024-09-19T07:07:15.091196+0000","last_peered":"2024-09-19T07:07:15.091196+0000","last_clean":"2024-09-19T07:07:15.091196+0000","last_became_active":"2024-09-19T07:07:15.087619+0000","last_became_peered":"2024-09-19T07:07:15.087619+0000","last_unstale":"2024-09-19T07:07:15.091196+0000","last_undegraded":"2024-09-19T07:07:15.091196+0000","last_fullsized":"2024-09-19T07:07:15.091196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:01.778892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059328+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:07:15.059328+0000","last_peered":"2024-09-19T07:07:15.059328+0000","last_clean":"2024-09-19T07:07:15.059328+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:07:15.059328+0000","last_undegraded":"2024-09-19T07:07:15.059328+0000","last_fullsized":"2024-09-19T07:07:15.059328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059519+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:07:15.059519+0000","last_peered":"2024-09-19T07:07:15.059519+0000","last_clean":"2024-09-19T07:07:15.059519+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:07:15.059519+0000","last_undegraded":"2024-09-19T07:07:15.059519+0000","last_fullsized":"2024-09-19T07:07:15.059519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178223+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:15.178223+0000","last_peered":"2024-09-19T07:07:15.178223+0000","last_clean":"2024-09-19T07:07:15.178223+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:15.178223+0000","last_undegraded":"2024-09-19T07:07:15.178223+0000","last_fullsized":"2024-09-19T07:07:15.178223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060171+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:07:15.060171+0000","last_peered":"2024-09-19T07:07:15.060171+0000","last_clean":"2024-09-19T07:07:15.060171+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:07:15.060171+0000","last_undegraded":"2024-09-19T07:07:15.060171+0000","last_fullsized":"2024-09-19T07:07:15.060171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064869+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:07:15.064869+0000","last_peered":"2024-09-19T07:07:15.064869+0000","last_clean":"2024-09-19T07:07:15.064869+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:07:15.064869+0000","last_undegraded":"2024-09-19T07:07:15.064869+0000","last_fullsized":"2024-09-19T07:07:15.064869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086202+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:15.086202+0000","last_peered":"2024-09-19T07:07:15.086202+0000","last_clean":"2024-09-19T07:07:15.086202+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:15.086202+0000","last_undegraded":"2024-09-19T07:07:15.086202+0000","last_fullsized":"2024-09-19T07:07:15.086202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064418+0000","last_change":"2024-09-19T07:07:15.064418+0000","last_active":"2024-09-19T07:07:15.064418+0000","last_peered":"2024-09-19T07:07:15.064418+0000","last_clean":"2024-09-19T07:07:15.064418+0000","last_became_active":"2024-09-19T07:07:15.063859+0000","last_became_peered":"2024-09-19T07:07:15.063859+0000","last_unstale":"2024-09-19T07:07:15.064418+0000","last_undegraded":"2024-09-19T07:07:15.064418+0000","last_fullsized":"2024-09-19T07:07:15.064418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:22.219231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,10,5],"acting":[4,3,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.065231+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:07:15.065231+0000","last_peered":"2024-09-19T07:07:15.065231+0000","last_clean":"2024-09-19T07:07:15.065231+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:07:15.065231+0000","last_undegraded":"2024-09-19T07:07:15.065231+0000","last_fullsized":"2024-09-19T07:07:15.065231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058483+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:15.058483+0000","last_peered":"2024-09-19T07:07:15.058483+0000","last_clean":"2024-09-19T07:07:15.058483+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:15.058483+0000","last_undegraded":"2024-09-19T07:07:15.058483+0000","last_fullsized":"2024-09-19T07:07:15.058483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060553+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:07:15.060553+0000","last_peered":"2024-09-19T07:07:15.060553+0000","last_clean":"2024-09-19T07:07:15.060553+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:07:15.060553+0000","last_undegraded":"2024-09-19T07:07:15.060553+0000","last_fullsized":"2024-09-19T07:07:15.060553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.072152+0000","last_change":"2024-09-19T07:07:15.072152+0000","last_active":"2024-09-19T07:07:15.072152+0000","last_peered":"2024-09-19T07:07:15.072152+0000","last_clean":"2024-09-19T07:07:15.072152+0000","last_became_active":"2024-09-19T07:07:15.066108+0000","last_became_peered":"2024-09-19T07:07:15.066108+0000","last_unstale":"2024-09-19T07:07:15.072152+0000","last_undegraded":"2024-09-19T07:07:15.072152+0000","last_fullsized":"2024-09-19T07:07:15.072152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:29.370693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060781+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:07:15.060781+0000","last_peered":"2024-09-19T07:07:15.060781+0000","last_clean":"2024-09-19T07:07:15.060781+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:07:15.060781+0000","last_undegraded":"2024-09-19T07:07:15.060781+0000","last_fullsized":"2024-09-19T07:07:15.060781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059299+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:07:15.059299+0000","last_peered":"2024-09-19T07:07:15.059299+0000","last_clean":"2024-09-19T07:07:15.059299+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:07:15.059299+0000","last_undegraded":"2024-09-19T07:07:15.059299+0000","last_fullsized":"2024-09-19T07:07:15.059299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067493+0000","last_change":"2024-09-19T07:07:15.066954+0000","last_active":"2024-09-19T07:07:15.067493+0000","last_peered":"2024-09-19T07:07:15.067493+0000","last_clean":"2024-09-19T07:07:15.067493+0000","last_became_active":"2024-09-19T07:07:15.066612+0000","last_became_peered":"2024-09-19T07:07:15.066612+0000","last_unstale":"2024-09-19T07:07:15.067493+0000","last_undegraded":"2024-09-19T07:07:15.067493+0000","last_fullsized":"2024-09-19T07:07:15.067493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:26.150407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060948+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:07:15.060948+0000","last_peered":"2024-09-19T07:07:15.060948+0000","last_clean":"2024-09-19T07:07:15.060948+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:07:15.060948+0000","last_undegraded":"2024-09-19T07:07:15.060948+0000","last_fullsized":"2024-09-19T07:07:15.060948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064344+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:07:15.064344+0000","last_peered":"2024-09-19T07:07:15.064344+0000","last_clean":"2024-09-19T07:07:15.064344+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:07:15.064344+0000","last_undegraded":"2024-09-19T07:07:15.064344+0000","last_fullsized":"2024-09-19T07:07:15.064344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059936+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:07:15.059936+0000","last_peered":"2024-09-19T07:07:15.059936+0000","last_clean":"2024-09-19T07:07:15.059936+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:07:15.059936+0000","last_undegraded":"2024-09-19T07:07:15.059936+0000","last_fullsized":"2024-09-19T07:07:15.059936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067359+0000","last_change":"2024-09-19T07:07:15.067359+0000","last_active":"2024-09-19T07:07:15.067359+0000","last_peered":"2024-09-19T07:07:15.067359+0000","last_clean":"2024-09-19T07:07:15.067359+0000","last_became_active":"2024-09-19T07:07:15.066885+0000","last_became_peered":"2024-09-19T07:07:15.066885+0000","last_unstale":"2024-09-19T07:07:15.067359+0000","last_undegraded":"2024-09-19T07:07:15.067359+0000","last_fullsized":"2024-09-19T07:07:15.067359+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:35.148606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059417+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:07:15.059417+0000","last_peered":"2024-09-19T07:07:15.059417+0000","last_clean":"2024-09-19T07:07:15.059417+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:07:15.059417+0000","last_undegraded":"2024-09-19T07:07:15.059417+0000","last_fullsized":"2024-09-19T07:07:15.059417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086017+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:15.086017+0000","last_peered":"2024-09-19T07:07:15.086017+0000","last_clean":"2024-09-19T07:07:15.086017+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:15.086017+0000","last_undegraded":"2024-09-19T07:07:15.086017+0000","last_fullsized":"2024-09-19T07:07:15.086017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060778+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:07:15.060778+0000","last_peered":"2024-09-19T07:07:15.060778+0000","last_clean":"2024-09-19T07:07:15.060778+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:07:15.060778+0000","last_undegraded":"2024-09-19T07:07:15.060778+0000","last_fullsized":"2024-09-19T07:07:15.060778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178074+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:15.178074+0000","last_peered":"2024-09-19T07:07:15.178074+0000","last_clean":"2024-09-19T07:07:15.178074+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:15.178074+0000","last_undegraded":"2024-09-19T07:07:15.178074+0000","last_fullsized":"2024-09-19T07:07:15.178074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061553+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:07:15.061553+0000","last_peered":"2024-09-19T07:07:15.061553+0000","last_clean":"2024-09-19T07:07:15.061553+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:07:15.061553+0000","last_undegraded":"2024-09-19T07:07:15.061553+0000","last_fullsized":"2024-09-19T07:07:15.061553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060645+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:07:15.060645+0000","last_peered":"2024-09-19T07:07:15.060645+0000","last_clean":"2024-09-19T07:07:15.060645+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:07:15.060645+0000","last_undegraded":"2024-09-19T07:07:15.060645+0000","last_fullsized":"2024-09-19T07:07:15.060645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.811839+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:15.811839+0000","last_peered":"2024-09-19T07:07:15.811839+0000","last_clean":"2024-09-19T07:07:15.811839+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:15.811839+0000","last_undegraded":"2024-09-19T07:07:15.811839+0000","last_fullsized":"2024-09-19T07:07:15.811839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058971+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:07:15.058971+0000","last_peered":"2024-09-19T07:07:15.058971+0000","last_clean":"2024-09-19T07:07:15.058971+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:07:15.058971+0000","last_undegraded":"2024-09-19T07:07:15.058971+0000","last_fullsized":"2024-09-19T07:07:15.058971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057010+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:15.057010+0000","last_peered":"2024-09-19T07:07:15.057010+0000","last_clean":"2024-09-19T07:07:15.057010+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:15.057010+0000","last_undegraded":"2024-09-19T07:07:15.057010+0000","last_fullsized":"2024-09-19T07:07:15.057010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064970+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:07:15.064970+0000","last_peered":"2024-09-19T07:07:15.064970+0000","last_clean":"2024-09-19T07:07:15.064970+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:07:15.064970+0000","last_undegraded":"2024-09-19T07:07:15.064970+0000","last_fullsized":"2024-09-19T07:07:15.064970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062074+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:07:15.062074+0000","last_peered":"2024-09-19T07:07:15.062074+0000","last_clean":"2024-09-19T07:07:15.062074+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:07:15.062074+0000","last_undegraded":"2024-09-19T07:07:15.062074+0000","last_fullsized":"2024-09-19T07:07:15.062074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061661+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:07:15.061661+0000","last_peered":"2024-09-19T07:07:15.061661+0000","last_clean":"2024-09-19T07:07:15.061661+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:07:15.061661+0000","last_undegraded":"2024-09-19T07:07:15.061661+0000","last_fullsized":"2024-09-19T07:07:15.061661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060362+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:07:15.060362+0000","last_peered":"2024-09-19T07:07:15.060362+0000","last_clean":"2024-09-19T07:07:15.060362+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:07:15.060362+0000","last_undegraded":"2024-09-19T07:07:15.060362+0000","last_fullsized":"2024-09-19T07:07:15.060362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062221+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:07:15.062221+0000","last_peered":"2024-09-19T07:07:15.062221+0000","last_clean":"2024-09-19T07:07:15.062221+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:07:15.062221+0000","last_undegraded":"2024-09-19T07:07:15.062221+0000","last_fullsized":"2024-09-19T07:07:15.062221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062339+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:07:15.062339+0000","last_peered":"2024-09-19T07:07:15.062339+0000","last_clean":"2024-09-19T07:07:15.062339+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:07:15.062339+0000","last_undegraded":"2024-09-19T07:07:15.062339+0000","last_fullsized":"2024-09-19T07:07:15.062339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056887+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:15.056887+0000","last_peered":"2024-09-19T07:07:15.056887+0000","last_clean":"2024-09-19T07:07:15.056887+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:15.056887+0000","last_undegraded":"2024-09-19T07:07:15.056887+0000","last_fullsized":"2024-09-19T07:07:15.056887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057741+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:15.057741+0000","last_peered":"2024-09-19T07:07:15.057741+0000","last_clean":"2024-09-19T07:07:15.057741+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:15.057741+0000","last_undegraded":"2024-09-19T07:07:15.057741+0000","last_fullsized":"2024-09-19T07:07:15.057741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056666+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:15.056666+0000","last_peered":"2024-09-19T07:07:15.056666+0000","last_clean":"2024-09-19T07:07:15.056666+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:15.056666+0000","last_undegraded":"2024-09-19T07:07:15.056666+0000","last_fullsized":"2024-09-19T07:07:15.056666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057025+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:15.057025+0000","last_peered":"2024-09-19T07:07:15.057025+0000","last_clean":"2024-09-19T07:07:15.057025+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:15.057025+0000","last_undegraded":"2024-09-19T07:07:15.057025+0000","last_fullsized":"2024-09-19T07:07:15.057025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056535+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:15.056535+0000","last_peered":"2024-09-19T07:07:15.056535+0000","last_clean":"2024-09-19T07:07:15.056535+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.056535+0000","last_undegraded":"2024-09-19T07:07:15.056535+0000","last_fullsized":"2024-09-19T07:07:15.056535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058690+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:15.058690+0000","last_peered":"2024-09-19T07:07:15.058690+0000","last_clean":"2024-09-19T07:07:15.058690+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:15.058690+0000","last_undegraded":"2024-09-19T07:07:15.058690+0000","last_fullsized":"2024-09-19T07:07:15.058690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059640+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:07:15.059640+0000","last_peered":"2024-09-19T07:07:15.059640+0000","last_clean":"2024-09-19T07:07:15.059640+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:07:15.059640+0000","last_undegraded":"2024-09-19T07:07:15.059640+0000","last_fullsized":"2024-09-19T07:07:15.059640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061668+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:07:15.061668+0000","last_peered":"2024-09-19T07:07:15.061668+0000","last_clean":"2024-09-19T07:07:15.061668+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:07:15.061668+0000","last_undegraded":"2024-09-19T07:07:15.061668+0000","last_fullsized":"2024-09-19T07:07:15.061668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057575+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057575+0000","last_peered":"2024-09-19T07:07:15.057575+0000","last_clean":"2024-09-19T07:07:15.057575+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057575+0000","last_undegraded":"2024-09-19T07:07:15.057575+0000","last_fullsized":"2024-09-19T07:07:15.057575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086015+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:15.086015+0000","last_peered":"2024-09-19T07:07:15.086015+0000","last_clean":"2024-09-19T07:07:15.086015+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:15.086015+0000","last_undegraded":"2024-09-19T07:07:15.086015+0000","last_fullsized":"2024-09-19T07:07:15.086015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058713+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:15.058713+0000","last_peered":"2024-09-19T07:07:15.058713+0000","last_clean":"2024-09-19T07:07:15.058713+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:15.058713+0000","last_undegraded":"2024-09-19T07:07:15.058713+0000","last_fullsized":"2024-09-19T07:07:15.058713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177840+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:15.177840+0000","last_peered":"2024-09-19T07:07:15.177840+0000","last_clean":"2024-09-19T07:07:15.177840+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:15.177840+0000","last_undegraded":"2024-09-19T07:07:15.177840+0000","last_fullsized":"2024-09-19T07:07:15.177840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067483+0000","last_change":"2024-09-19T07:07:15.067483+0000","last_active":"2024-09-19T07:07:15.067483+0000","last_peered":"2024-09-19T07:07:15.067483+0000","last_clean":"2024-09-19T07:07:15.067483+0000","last_became_active":"2024-09-19T07:07:15.064076+0000","last_became_peered":"2024-09-19T07:07:15.064076+0000","last_unstale":"2024-09-19T07:07:15.067483+0000","last_undegraded":"2024-09-19T07:07:15.067483+0000","last_fullsized":"2024-09-19T07:07:15.067483+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:42.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057614+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:15.057614+0000","last_peered":"2024-09-19T07:07:15.057614+0000","last_clean":"2024-09-19T07:07:15.057614+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:15.057614+0000","last_undegraded":"2024-09-19T07:07:15.057614+0000","last_fullsized":"2024-09-19T07:07:15.057614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063452+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:07:15.063452+0000","last_peered":"2024-09-19T07:07:15.063452+0000","last_clean":"2024-09-19T07:07:15.063452+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:07:15.063452+0000","last_undegraded":"2024-09-19T07:07:15.063452+0000","last_fullsized":"2024-09-19T07:07:15.063452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.070425+0000","last_change":"2024-09-19T07:07:15.069990+0000","last_active":"2024-09-19T07:07:15.070425+0000","last_peered":"2024-09-19T07:07:15.070425+0000","last_clean":"2024-09-19T07:07:15.070425+0000","last_became_active":"2024-09-19T07:07:15.064494+0000","last_became_peered":"2024-09-19T07:07:15.064494+0000","last_unstale":"2024-09-19T07:07:15.070425+0000","last_undegraded":"2024-09-19T07:07:15.070425+0000","last_fullsized":"2024-09-19T07:07:15.070425+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:45.233325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057683+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:15.057683+0000","last_peered":"2024-09-19T07:07:15.057683+0000","last_clean":"2024-09-19T07:07:15.057683+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:15.057683+0000","last_undegraded":"2024-09-19T07:07:15.057683+0000","last_fullsized":"2024-09-19T07:07:15.057683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057775+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:15.057775+0000","last_peered":"2024-09-19T07:07:15.057775+0000","last_clean":"2024-09-19T07:07:15.057775+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:15.057775+0000","last_undegraded":"2024-09-19T07:07:15.057775+0000","last_fullsized":"2024-09-19T07:07:15.057775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062951+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:07:15.062951+0000","last_peered":"2024-09-19T07:07:15.062951+0000","last_clean":"2024-09-19T07:07:15.062951+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:07:15.062951+0000","last_undegraded":"2024-09-19T07:07:15.062951+0000","last_fullsized":"2024-09-19T07:07:15.062951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057175+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:15.057175+0000","last_peered":"2024-09-19T07:07:15.057175+0000","last_clean":"2024-09-19T07:07:15.057175+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:15.057175+0000","last_undegraded":"2024-09-19T07:07:15.057175+0000","last_fullsized":"2024-09-19T07:07:15.057175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060703+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:07:15.060703+0000","last_peered":"2024-09-19T07:07:15.060703+0000","last_clean":"2024-09-19T07:07:15.060703+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:07:15.060703+0000","last_undegraded":"2024-09-19T07:07:15.060703+0000","last_fullsized":"2024-09-19T07:07:15.060703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061227+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:07:15.061227+0000","last_peered":"2024-09-19T07:07:15.061227+0000","last_clean":"2024-09-19T07:07:15.061227+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:07:15.061227+0000","last_undegraded":"2024-09-19T07:07:15.061227+0000","last_fullsized":"2024-09-19T07:07:15.061227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057997+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:15.057997+0000","last_peered":"2024-09-19T07:07:15.057997+0000","last_clean":"2024-09-19T07:07:15.057997+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:15.057997+0000","last_undegraded":"2024-09-19T07:07:15.057997+0000","last_fullsized":"2024-09-19T07:07:15.057997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062190+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:07:15.062190+0000","last_peered":"2024-09-19T07:07:15.062190+0000","last_clean":"2024-09-19T07:07:15.062190+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:07:15.062190+0000","last_undegraded":"2024-09-19T07:07:15.062190+0000","last_fullsized":"2024-09-19T07:07:15.062190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056695+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:15.056695+0000","last_peered":"2024-09-19T07:07:15.056695+0000","last_clean":"2024-09-19T07:07:15.056695+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:15.056695+0000","last_undegraded":"2024-09-19T07:07:15.056695+0000","last_fullsized":"2024-09-19T07:07:15.056695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058263+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:15.058263+0000","last_peered":"2024-09-19T07:07:15.058263+0000","last_clean":"2024-09-19T07:07:15.058263+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:15.058263+0000","last_undegraded":"2024-09-19T07:07:15.058263+0000","last_fullsized":"2024-09-19T07:07:15.058263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064712+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:07:15.064712+0000","last_peered":"2024-09-19T07:07:15.064712+0000","last_clean":"2024-09-19T07:07:15.064712+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:07:15.064712+0000","last_undegraded":"2024-09-19T07:07:15.064712+0000","last_fullsized":"2024-09-19T07:07:15.064712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'28","reported_seq":103,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:17.043862+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:07:17.043862+0000","last_peered":"2024-09-19T07:07:17.043862+0000","last_clean":"2024-09-19T07:07:17.043862+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:07:17.043862+0000","last_undegraded":"2024-09-19T07:07:17.043862+0000","last_fullsized":"2024-09-19T07:07:17.043862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59246,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":78,"num_write":28,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060105+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:07:15.060105+0000","last_peered":"2024-09-19T07:07:15.060105+0000","last_clean":"2024-09-19T07:07:15.060105+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:07:15.060105+0000","last_undegraded":"2024-09-19T07:07:15.060105+0000","last_fullsized":"2024-09-19T07:07:15.060105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086241+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:15.086241+0000","last_peered":"2024-09-19T07:07:15.086241+0000","last_clean":"2024-09-19T07:07:15.086241+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.086241+0000","last_undegraded":"2024-09-19T07:07:15.086241+0000","last_fullsized":"2024-09-19T07:07:15.086241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058608+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:15.058608+0000","last_peered":"2024-09-19T07:07:15.058608+0000","last_clean":"2024-09-19T07:07:15.058608+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:15.058608+0000","last_undegraded":"2024-09-19T07:07:15.058608+0000","last_fullsized":"2024-09-19T07:07:15.058608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061390+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:07:15.061390+0000","last_peered":"2024-09-19T07:07:15.061390+0000","last_clean":"2024-09-19T07:07:15.061390+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:07:15.061390+0000","last_undegraded":"2024-09-19T07:07:15.061390+0000","last_fullsized":"2024-09-19T07:07:15.061390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178243+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:15.178243+0000","last_peered":"2024-09-19T07:07:15.178243+0000","last_clean":"2024-09-19T07:07:15.178243+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:15.178243+0000","last_undegraded":"2024-09-19T07:07:15.178243+0000","last_fullsized":"2024-09-19T07:07:15.178243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059369+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:07:15.059369+0000","last_peered":"2024-09-19T07:07:15.059369+0000","last_clean":"2024-09-19T07:07:15.059369+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:07:15.059369+0000","last_undegraded":"2024-09-19T07:07:15.059369+0000","last_fullsized":"2024-09-19T07:07:15.059369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086511+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:15.086511+0000","last_peered":"2024-09-19T07:07:15.086511+0000","last_clean":"2024-09-19T07:07:15.086511+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:15.086511+0000","last_undegraded":"2024-09-19T07:07:15.086511+0000","last_fullsized":"2024-09-19T07:07:15.086511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062233+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:07:15.062233+0000","last_peered":"2024-09-19T07:07:15.062233+0000","last_clean":"2024-09-19T07:07:15.062233+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:07:15.062233+0000","last_undegraded":"2024-09-19T07:07:15.062233+0000","last_fullsized":"2024-09-19T07:07:15.062233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059669+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:07:15.059669+0000","last_peered":"2024-09-19T07:07:15.059669+0000","last_clean":"2024-09-19T07:07:15.059669+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:07:15.059669+0000","last_undegraded":"2024-09-19T07:07:15.059669+0000","last_fullsized":"2024-09-19T07:07:15.059669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177946+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:15.177946+0000","last_peered":"2024-09-19T07:07:15.177946+0000","last_clean":"2024-09-19T07:07:15.177946+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:15.177946+0000","last_undegraded":"2024-09-19T07:07:15.177946+0000","last_fullsized":"2024-09-19T07:07:15.177946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059855+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:07:15.059855+0000","last_peered":"2024-09-19T07:07:15.059855+0000","last_clean":"2024-09-19T07:07:15.059855+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:07:15.059855+0000","last_undegraded":"2024-09-19T07:07:15.059855+0000","last_fullsized":"2024-09-19T07:07:15.059855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057987+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:15.057987+0000","last_peered":"2024-09-19T07:07:15.057987+0000","last_clean":"2024-09-19T07:07:15.057987+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:15.057987+0000","last_undegraded":"2024-09-19T07:07:15.057987+0000","last_fullsized":"2024-09-19T07:07:15.057987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179142+0000","last_change":"2024-09-19T07:07:15.179142+0000","last_active":"2024-09-19T07:07:15.179142+0000","last_peered":"2024-09-19T07:07:15.179142+0000","last_clean":"2024-09-19T07:07:15.179142+0000","last_became_active":"2024-09-19T07:07:15.178586+0000","last_became_peered":"2024-09-19T07:07:15.178586+0000","last_unstale":"2024-09-19T07:07:15.179142+0000","last_undegraded":"2024-09-19T07:07:15.179142+0000","last_fullsized":"2024-09-19T07:07:15.179142+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:24.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059113+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:07:15.059113+0000","last_peered":"2024-09-19T07:07:15.059113+0000","last_clean":"2024-09-19T07:07:15.059113+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:07:15.059113+0000","last_undegraded":"2024-09-19T07:07:15.059113+0000","last_fullsized":"2024-09-19T07:07:15.059113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056560+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:15.056560+0000","last_peered":"2024-09-19T07:07:15.056560+0000","last_clean":"2024-09-19T07:07:15.056560+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:15.056560+0000","last_undegraded":"2024-09-19T07:07:15.056560+0000","last_fullsized":"2024-09-19T07:07:15.056560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061522+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:07:15.061522+0000","last_peered":"2024-09-19T07:07:15.061522+0000","last_clean":"2024-09-19T07:07:15.061522+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:07:15.061522+0000","last_undegraded":"2024-09-19T07:07:15.061522+0000","last_fullsized":"2024-09-19T07:07:15.061522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058324+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:15.058324+0000","last_peered":"2024-09-19T07:07:15.058324+0000","last_clean":"2024-09-19T07:07:15.058324+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:15.058324+0000","last_undegraded":"2024-09-19T07:07:15.058324+0000","last_fullsized":"2024-09-19T07:07:15.058324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058457+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:15.058457+0000","last_peered":"2024-09-19T07:07:15.058457+0000","last_clean":"2024-09-19T07:07:15.058457+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:15.058457+0000","last_undegraded":"2024-09-19T07:07:15.058457+0000","last_fullsized":"2024-09-19T07:07:15.058457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062435+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:07:15.062435+0000","last_peered":"2024-09-19T07:07:15.062435+0000","last_clean":"2024-09-19T07:07:15.062435+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:07:15.062435+0000","last_undegraded":"2024-09-19T07:07:15.062435+0000","last_fullsized":"2024-09-19T07:07:15.062435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064296+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:07:15.064296+0000","last_peered":"2024-09-19T07:07:15.064296+0000","last_clean":"2024-09-19T07:07:15.064296+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:07:15.064296+0000","last_undegraded":"2024-09-19T07:07:15.064296+0000","last_fullsized":"2024-09-19T07:07:15.064296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177982+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:15.177982+0000","last_peered":"2024-09-19T07:07:15.177982+0000","last_clean":"2024-09-19T07:07:15.177982+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:15.177982+0000","last_undegraded":"2024-09-19T07:07:15.177982+0000","last_fullsized":"2024-09-19T07:07:15.177982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057006+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:15.057006+0000","last_peered":"2024-09-19T07:07:15.057006+0000","last_clean":"2024-09-19T07:07:15.057006+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:15.057006+0000","last_undegraded":"2024-09-19T07:07:15.057006+0000","last_fullsized":"2024-09-19T07:07:15.057006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063399+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:07:15.063399+0000","last_peered":"2024-09-19T07:07:15.063399+0000","last_clean":"2024-09-19T07:07:15.063399+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:07:15.063399+0000","last_undegraded":"2024-09-19T07:07:15.063399+0000","last_fullsized":"2024-09-19T07:07:15.063399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057769+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:15.057769+0000","last_peered":"2024-09-19T07:07:15.057769+0000","last_clean":"2024-09-19T07:07:15.057769+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:15.057769+0000","last_undegraded":"2024-09-19T07:07:15.057769+0000","last_fullsized":"2024-09-19T07:07:15.057769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059836+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:07:15.059836+0000","last_peered":"2024-09-19T07:07:15.059836+0000","last_clean":"2024-09-19T07:07:15.059836+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:07:15.059836+0000","last_undegraded":"2024-09-19T07:07:15.059836+0000","last_fullsized":"2024-09-19T07:07:15.059836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086193+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:15.086193+0000","last_peered":"2024-09-19T07:07:15.086193+0000","last_clean":"2024-09-19T07:07:15.086193+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:15.086193+0000","last_undegraded":"2024-09-19T07:07:15.086193+0000","last_fullsized":"2024-09-19T07:07:15.086193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056901+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:15.056901+0000","last_peered":"2024-09-19T07:07:15.056901+0000","last_clean":"2024-09-19T07:07:15.056901+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:15.056901+0000","last_undegraded":"2024-09-19T07:07:15.056901+0000","last_fullsized":"2024-09-19T07:07:15.056901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061870+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:07:15.061870+0000","last_peered":"2024-09-19T07:07:15.061870+0000","last_clean":"2024-09-19T07:07:15.061870+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:07:15.061870+0000","last_undegraded":"2024-09-19T07:07:15.061870+0000","last_fullsized":"2024-09-19T07:07:15.061870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060878+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:07:15.060878+0000","last_peered":"2024-09-19T07:07:15.060878+0000","last_clean":"2024-09-19T07:07:15.060878+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:07:15.060878+0000","last_undegraded":"2024-09-19T07:07:15.060878+0000","last_fullsized":"2024-09-19T07:07:15.060878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063278+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:07:15.063278+0000","last_peered":"2024-09-19T07:07:15.063278+0000","last_clean":"2024-09-19T07:07:15.063278+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:07:15.063278+0000","last_undegraded":"2024-09-19T07:07:15.063278+0000","last_fullsized":"2024-09-19T07:07:15.063278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.085854+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:15.085854+0000","last_peered":"2024-09-19T07:07:15.085854+0000","last_clean":"2024-09-19T07:07:15.085854+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:15.085854+0000","last_undegraded":"2024-09-19T07:07:15.085854+0000","last_fullsized":"2024-09-19T07:07:15.085854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177830+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:15.177830+0000","last_peered":"2024-09-19T07:07:15.177830+0000","last_clean":"2024-09-19T07:07:15.177830+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:15.177830+0000","last_undegraded":"2024-09-19T07:07:15.177830+0000","last_fullsized":"2024-09-19T07:07:15.177830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177571+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:15.177571+0000","last_peered":"2024-09-19T07:07:15.177571+0000","last_clean":"2024-09-19T07:07:15.177571+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:15.177571+0000","last_undegraded":"2024-09-19T07:07:15.177571+0000","last_fullsized":"2024-09-19T07:07:15.177571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056875+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:15.056875+0000","last_peered":"2024-09-19T07:07:15.056875+0000","last_clean":"2024-09-19T07:07:15.056875+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:15.056875+0000","last_undegraded":"2024-09-19T07:07:15.056875+0000","last_fullsized":"2024-09-19T07:07:15.056875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061384+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:07:15.061384+0000","last_peered":"2024-09-19T07:07:15.061384+0000","last_clean":"2024-09-19T07:07:15.061384+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:07:15.061384+0000","last_undegraded":"2024-09-19T07:07:15.061384+0000","last_fullsized":"2024-09-19T07:07:15.061384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067182+0000","last_change":"2024-09-19T07:07:15.067182+0000","last_active":"2024-09-19T07:07:15.067182+0000","last_peered":"2024-09-19T07:07:15.067182+0000","last_clean":"2024-09-19T07:07:15.067182+0000","last_became_active":"2024-09-19T07:07:15.066805+0000","last_became_peered":"2024-09-19T07:07:15.066805+0000","last_unstale":"2024-09-19T07:07:15.067182+0000","last_undegraded":"2024-09-19T07:07:15.067182+0000","last_fullsized":"2024-09-19T07:07:15.067182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:05.606025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086686+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:15.086686+0000","last_peered":"2024-09-19T07:07:15.086686+0000","last_clean":"2024-09-19T07:07:15.086686+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:15.086686+0000","last_undegraded":"2024-09-19T07:07:15.086686+0000","last_fullsized":"2024-09-19T07:07:15.086686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059089+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:07:15.059089+0000","last_peered":"2024-09-19T07:07:15.059089+0000","last_clean":"2024-09-19T07:07:15.059089+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:07:15.059089+0000","last_undegraded":"2024-09-19T07:07:15.059089+0000","last_fullsized":"2024-09-19T07:07:15.059089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061406+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:07:15.061406+0000","last_peered":"2024-09-19T07:07:15.061406+0000","last_clean":"2024-09-19T07:07:15.061406+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:07:15.061406+0000","last_undegraded":"2024-09-19T07:07:15.061406+0000","last_fullsized":"2024-09-19T07:07:15.061406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064389+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:07:15.064389+0000","last_peered":"2024-09-19T07:07:15.064389+0000","last_clean":"2024-09-19T07:07:15.064389+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:07:15.064389+0000","last_undegraded":"2024-09-19T07:07:15.064389+0000","last_fullsized":"2024-09-19T07:07:15.064389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061304+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:07:15.061304+0000","last_peered":"2024-09-19T07:07:15.061304+0000","last_clean":"2024-09-19T07:07:15.061304+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:07:15.061304+0000","last_undegraded":"2024-09-19T07:07:15.061304+0000","last_fullsized":"2024-09-19T07:07:15.061304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177882+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:15.177882+0000","last_peered":"2024-09-19T07:07:15.177882+0000","last_clean":"2024-09-19T07:07:15.177882+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:15.177882+0000","last_undegraded":"2024-09-19T07:07:15.177882+0000","last_fullsized":"2024-09-19T07:07:15.177882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178041+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:15.178041+0000","last_peered":"2024-09-19T07:07:15.178041+0000","last_clean":"2024-09-19T07:07:15.178041+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:15.178041+0000","last_undegraded":"2024-09-19T07:07:15.178041+0000","last_fullsized":"2024-09-19T07:07:15.178041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062462+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:07:15.062462+0000","last_peered":"2024-09-19T07:07:15.062462+0000","last_clean":"2024-09-19T07:07:15.062462+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:07:15.062462+0000","last_undegraded":"2024-09-19T07:07:15.062462+0000","last_fullsized":"2024-09-19T07:07:15.062462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60044,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":46,"num_read_kb":83,"num_write":83,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":184397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514520,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743452,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1687552,"data_stored":1150335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906977,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1024000,"data_stored":509301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":504623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561073,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1622016,"data_stored":1095173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":500631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":559807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1085440,"data_stored":560355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1015808,"data_stored":500617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:07:24.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:24 smithi046 ceph-mon[34147]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:24.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:24 smithi078 ceph-mon[34556]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:25 smithi029 ceph-mon[31255]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.8 KiB/s wr, 3 op/s; 61 B/s, 0 objects/s recovering 2024-09-19T07:07:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:25 smithi078 ceph-mon[34556]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.8 KiB/s wr, 3 op/s; 61 B/s, 0 objects/s recovering 2024-09-19T07:07:25.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:25.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:25.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:25 smithi046 ceph-mon[34147]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.8 KiB/s wr, 3 op/s; 61 B/s, 0 objects/s recovering 2024-09-19T07:07:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:07:27.466 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:07:27.863 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:27 smithi029 ceph-mon[31255]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 55 B/s, 0 objects/s recovering 2024-09-19T07:07:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:27 smithi078 ceph-mon[34556]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 55 B/s, 0 objects/s recovering 2024-09-19T07:07:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:27 smithi046 ceph-mon[34147]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 55 B/s, 0 objects/s recovering 2024-09-19T07:07:28.107 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:28.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 -- 172.21.15.29:0/1964509556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b410c180 msgr2=0x7f21b410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 --2- 172.21.15.29:0/1964509556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b410c180 0x7f21b410e600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009ca0 tx=0x7f21ac02a950 comp rx=0 tx=0).stop 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 -- 172.21.15.29:0/1964509556 shutdown_connections 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 --2- 172.21.15.29:0/1964509556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b410c180 0x7f21b410e600 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 --2- 172.21.15.29:0/1964509556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b41036c0 0x7f21b410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 --2- 172.21.15.29:0/1964509556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b4102da0 0x7f21b4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.648+0000 7f21bb849640 1 -- 172.21.15.29:0/1964509556 >> 172.21.15.29:0/1964509556 conn(0x7f21b40fc7a0 msgr2=0x7f21b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 -- 172.21.15.29:0/1964509556 shutdown_connections 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 -- 172.21.15.29:0/1964509556 wait complete. 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 Processor -- start 2024-09-19T07:07:28.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 -- start start 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 0x7f21b4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b41036c0 0x7f21b4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b410c180 0x7f21b419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4111df0 con 0x7f21b4102da0 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4111c70 con 0x7f21b41036c0 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21bb849640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f21b4111f70 con 0x7f21b410c180 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.649+0000 7f21b95e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 0x7f21b4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 0x7f21b4198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58262/0 (socket says 172.21.15.29:58262) 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 -- 172.21.15.29:0/940870917 learned_addr learned my addr 172.21.15.29:0/940870917 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b9de6640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b410c180 0x7f21b419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b8de4640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b41036c0 0x7f21b4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:28.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 -- 172.21.15.29:0/940870917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b410c180 msgr2=0x7f21b419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b410c180 0x7f21b419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 -- 172.21.15.29:0/940870917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b41036c0 msgr2=0x7f21b4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b41036c0 0x7f21b4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 -- 172.21.15.29:0/940870917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b419d2e0 con 0x7f21b4102da0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b9de6640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b410c180 0x7f21b419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b8de4640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b41036c0 0x7f21b4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21b95e5640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 0x7f21b4198330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d950 tx=0x7f21b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0017030 con 0x7f21b4102da0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b419d5d0 con 0x7f21b4102da0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f21b0004020 con 0x7f21b4102da0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00047a0 con 0x7f21b4102da0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.650+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b41a4eb0 con 0x7f21b4102da0 2024-09-19T07:07:28.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.651+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b4103180 con 0x7f21b4102da0 2024-09-19T07:07:28.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.653+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f21b00041d0 con 0x7f21b4102da0 2024-09-19T07:07:28.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.653+0000 7f21a67fc640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f21a00a32d0 0x7f21a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:28.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.653+0000 7f21b8de4640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f21a00a32d0 0x7f21a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:28.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.653+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f21b00cff90 con 0x7f21b4102da0 2024-09-19T07:07:28.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.654+0000 7f21b8de4640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f21a00a32d0 0x7f21a00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a80094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:28.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.656+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21b009c7f0 con 0x7f21b4102da0 2024-09-19T07:07:28.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.832+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21b4062630 con 0x7f21a00a32d0 2024-09-19T07:07:28.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.841+0000 7f21a67fc640 1 -- 172.21.15.29:0/940870917 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340293 (secure 0 0 0) 0x7f21b4062630 con 0x7f21a00a32d0 2024-09-19T07:07:28.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:28.848 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:07:28.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f21a00a32d0 msgr2=0x7f21a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:28.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f21a00a32d0 0x7f21a00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21a8005fd0 tx=0x7f21a80094d0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 msgr2=0x7f21b4198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:28.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 0x7f21b4198330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d950 tx=0x7f21b000de10 comp rx=0 tx=0).stop 2024-09-19T07:07:28.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 shutdown_connections 2024-09-19T07:07:28.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f21a00a32d0 0x7f21a00a5790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21b410c180 0x7f21b419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b41036c0 0x7f21b4198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 --2- 172.21.15.29:0/940870917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21b4102da0 0x7f21b4198330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:28.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.844+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 >> 172.21.15.29:0/940870917 conn(0x7f21b40fc7a0 msgr2=0x7f21b40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:28.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.845+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 shutdown_connections 2024-09-19T07:07:28.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:28.845+0000 7f21bb849640 1 -- 172.21.15.29:0/940870917 wait complete. 2024-09-19T07:07:29.677 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-19T07:07:27.857427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":193,"num_read_kb":207,"num_write":268,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181340,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404816,"kb_used_data":13904,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537008,"statfs":{"total":1151940427776,"available":1151525896192,"internally_reserved":0,"allocated":14237696,"data_stored":8003123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14413,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":29,"num_write":14,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003258"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.091196+0000","last_change":"2024-09-19T07:07:15.091196+0000","last_active":"2024-09-19T07:07:15.091196+0000","last_peered":"2024-09-19T07:07:15.091196+0000","last_clean":"2024-09-19T07:07:15.091196+0000","last_became_active":"2024-09-19T07:07:15.087619+0000","last_became_peered":"2024-09-19T07:07:15.087619+0000","last_unstale":"2024-09-19T07:07:15.091196+0000","last_undegraded":"2024-09-19T07:07:15.091196+0000","last_fullsized":"2024-09-19T07:07:15.091196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:01.778892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059328+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:07:15.059328+0000","last_peered":"2024-09-19T07:07:15.059328+0000","last_clean":"2024-09-19T07:07:15.059328+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:07:15.059328+0000","last_undegraded":"2024-09-19T07:07:15.059328+0000","last_fullsized":"2024-09-19T07:07:15.059328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059519+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:07:15.059519+0000","last_peered":"2024-09-19T07:07:15.059519+0000","last_clean":"2024-09-19T07:07:15.059519+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:07:15.059519+0000","last_undegraded":"2024-09-19T07:07:15.059519+0000","last_fullsized":"2024-09-19T07:07:15.059519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178223+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:15.178223+0000","last_peered":"2024-09-19T07:07:15.178223+0000","last_clean":"2024-09-19T07:07:15.178223+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:15.178223+0000","last_undegraded":"2024-09-19T07:07:15.178223+0000","last_fullsized":"2024-09-19T07:07:15.178223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060171+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:07:15.060171+0000","last_peered":"2024-09-19T07:07:15.060171+0000","last_clean":"2024-09-19T07:07:15.060171+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:07:15.060171+0000","last_undegraded":"2024-09-19T07:07:15.060171+0000","last_fullsized":"2024-09-19T07:07:15.060171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064869+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:07:15.064869+0000","last_peered":"2024-09-19T07:07:15.064869+0000","last_clean":"2024-09-19T07:07:15.064869+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:07:15.064869+0000","last_undegraded":"2024-09-19T07:07:15.064869+0000","last_fullsized":"2024-09-19T07:07:15.064869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086202+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:15.086202+0000","last_peered":"2024-09-19T07:07:15.086202+0000","last_clean":"2024-09-19T07:07:15.086202+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:15.086202+0000","last_undegraded":"2024-09-19T07:07:15.086202+0000","last_fullsized":"2024-09-19T07:07:15.086202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064418+0000","last_change":"2024-09-19T07:07:15.064418+0000","last_active":"2024-09-19T07:07:15.064418+0000","last_peered":"2024-09-19T07:07:15.064418+0000","last_clean":"2024-09-19T07:07:15.064418+0000","last_became_active":"2024-09-19T07:07:15.063859+0000","last_became_peered":"2024-09-19T07:07:15.063859+0000","last_unstale":"2024-09-19T07:07:15.064418+0000","last_undegraded":"2024-09-19T07:07:15.064418+0000","last_fullsized":"2024-09-19T07:07:15.064418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:22.219231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,10,5],"acting":[4,3,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.065231+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:07:15.065231+0000","last_peered":"2024-09-19T07:07:15.065231+0000","last_clean":"2024-09-19T07:07:15.065231+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:07:15.065231+0000","last_undegraded":"2024-09-19T07:07:15.065231+0000","last_fullsized":"2024-09-19T07:07:15.065231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058483+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:15.058483+0000","last_peered":"2024-09-19T07:07:15.058483+0000","last_clean":"2024-09-19T07:07:15.058483+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:15.058483+0000","last_undegraded":"2024-09-19T07:07:15.058483+0000","last_fullsized":"2024-09-19T07:07:15.058483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060553+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:07:15.060553+0000","last_peered":"2024-09-19T07:07:15.060553+0000","last_clean":"2024-09-19T07:07:15.060553+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:07:15.060553+0000","last_undegraded":"2024-09-19T07:07:15.060553+0000","last_fullsized":"2024-09-19T07:07:15.060553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.072152+0000","last_change":"2024-09-19T07:07:15.072152+0000","last_active":"2024-09-19T07:07:15.072152+0000","last_peered":"2024-09-19T07:07:15.072152+0000","last_clean":"2024-09-19T07:07:15.072152+0000","last_became_active":"2024-09-19T07:07:15.066108+0000","last_became_peered":"2024-09-19T07:07:15.066108+0000","last_unstale":"2024-09-19T07:07:15.072152+0000","last_undegraded":"2024-09-19T07:07:15.072152+0000","last_fullsized":"2024-09-19T07:07:15.072152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:29.370693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060781+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:07:15.060781+0000","last_peered":"2024-09-19T07:07:15.060781+0000","last_clean":"2024-09-19T07:07:15.060781+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:07:15.060781+0000","last_undegraded":"2024-09-19T07:07:15.060781+0000","last_fullsized":"2024-09-19T07:07:15.060781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059299+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:07:15.059299+0000","last_peered":"2024-09-19T07:07:15.059299+0000","last_clean":"2024-09-19T07:07:15.059299+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:07:15.059299+0000","last_undegraded":"2024-09-19T07:07:15.059299+0000","last_fullsized":"2024-09-19T07:07:15.059299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067493+0000","last_change":"2024-09-19T07:07:15.066954+0000","last_active":"2024-09-19T07:07:15.067493+0000","last_peered":"2024-09-19T07:07:15.067493+0000","last_clean":"2024-09-19T07:07:15.067493+0000","last_became_active":"2024-09-19T07:07:15.066612+0000","last_became_peered":"2024-09-19T07:07:15.066612+0000","last_unstale":"2024-09-19T07:07:15.067493+0000","last_undegraded":"2024-09-19T07:07:15.067493+0000","last_fullsized":"2024-09-19T07:07:15.067493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:26.150407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060948+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:07:15.060948+0000","last_peered":"2024-09-19T07:07:15.060948+0000","last_clean":"2024-09-19T07:07:15.060948+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:07:15.060948+0000","last_undegraded":"2024-09-19T07:07:15.060948+0000","last_fullsized":"2024-09-19T07:07:15.060948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064344+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:07:15.064344+0000","last_peered":"2024-09-19T07:07:15.064344+0000","last_clean":"2024-09-19T07:07:15.064344+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:07:15.064344+0000","last_undegraded":"2024-09-19T07:07:15.064344+0000","last_fullsized":"2024-09-19T07:07:15.064344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059936+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:07:15.059936+0000","last_peered":"2024-09-19T07:07:15.059936+0000","last_clean":"2024-09-19T07:07:15.059936+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:07:15.059936+0000","last_undegraded":"2024-09-19T07:07:15.059936+0000","last_fullsized":"2024-09-19T07:07:15.059936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067359+0000","last_change":"2024-09-19T07:07:15.067359+0000","last_active":"2024-09-19T07:07:15.067359+0000","last_peered":"2024-09-19T07:07:15.067359+0000","last_clean":"2024-09-19T07:07:15.067359+0000","last_became_active":"2024-09-19T07:07:15.066885+0000","last_became_peered":"2024-09-19T07:07:15.066885+0000","last_unstale":"2024-09-19T07:07:15.067359+0000","last_undegraded":"2024-09-19T07:07:15.067359+0000","last_fullsized":"2024-09-19T07:07:15.067359+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:35.148606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059417+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:07:15.059417+0000","last_peered":"2024-09-19T07:07:15.059417+0000","last_clean":"2024-09-19T07:07:15.059417+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:07:15.059417+0000","last_undegraded":"2024-09-19T07:07:15.059417+0000","last_fullsized":"2024-09-19T07:07:15.059417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086017+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:15.086017+0000","last_peered":"2024-09-19T07:07:15.086017+0000","last_clean":"2024-09-19T07:07:15.086017+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:15.086017+0000","last_undegraded":"2024-09-19T07:07:15.086017+0000","last_fullsized":"2024-09-19T07:07:15.086017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060778+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:07:15.060778+0000","last_peered":"2024-09-19T07:07:15.060778+0000","last_clean":"2024-09-19T07:07:15.060778+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:07:15.060778+0000","last_undegraded":"2024-09-19T07:07:15.060778+0000","last_fullsized":"2024-09-19T07:07:15.060778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178074+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:15.178074+0000","last_peered":"2024-09-19T07:07:15.178074+0000","last_clean":"2024-09-19T07:07:15.178074+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:15.178074+0000","last_undegraded":"2024-09-19T07:07:15.178074+0000","last_fullsized":"2024-09-19T07:07:15.178074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061553+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:07:15.061553+0000","last_peered":"2024-09-19T07:07:15.061553+0000","last_clean":"2024-09-19T07:07:15.061553+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:07:15.061553+0000","last_undegraded":"2024-09-19T07:07:15.061553+0000","last_fullsized":"2024-09-19T07:07:15.061553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060645+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:07:15.060645+0000","last_peered":"2024-09-19T07:07:15.060645+0000","last_clean":"2024-09-19T07:07:15.060645+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:07:15.060645+0000","last_undegraded":"2024-09-19T07:07:15.060645+0000","last_fullsized":"2024-09-19T07:07:15.060645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.811839+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:15.811839+0000","last_peered":"2024-09-19T07:07:15.811839+0000","last_clean":"2024-09-19T07:07:15.811839+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:15.811839+0000","last_undegraded":"2024-09-19T07:07:15.811839+0000","last_fullsized":"2024-09-19T07:07:15.811839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058971+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:07:15.058971+0000","last_peered":"2024-09-19T07:07:15.058971+0000","last_clean":"2024-09-19T07:07:15.058971+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:07:15.058971+0000","last_undegraded":"2024-09-19T07:07:15.058971+0000","last_fullsized":"2024-09-19T07:07:15.058971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057010+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:15.057010+0000","last_peered":"2024-09-19T07:07:15.057010+0000","last_clean":"2024-09-19T07:07:15.057010+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:15.057010+0000","last_undegraded":"2024-09-19T07:07:15.057010+0000","last_fullsized":"2024-09-19T07:07:15.057010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064970+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:07:15.064970+0000","last_peered":"2024-09-19T07:07:15.064970+0000","last_clean":"2024-09-19T07:07:15.064970+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:07:15.064970+0000","last_undegraded":"2024-09-19T07:07:15.064970+0000","last_fullsized":"2024-09-19T07:07:15.064970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062074+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:07:15.062074+0000","last_peered":"2024-09-19T07:07:15.062074+0000","last_clean":"2024-09-19T07:07:15.062074+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:07:15.062074+0000","last_undegraded":"2024-09-19T07:07:15.062074+0000","last_fullsized":"2024-09-19T07:07:15.062074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061661+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:07:15.061661+0000","last_peered":"2024-09-19T07:07:15.061661+0000","last_clean":"2024-09-19T07:07:15.061661+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:07:15.061661+0000","last_undegraded":"2024-09-19T07:07:15.061661+0000","last_fullsized":"2024-09-19T07:07:15.061661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060362+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:07:15.060362+0000","last_peered":"2024-09-19T07:07:15.060362+0000","last_clean":"2024-09-19T07:07:15.060362+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:07:15.060362+0000","last_undegraded":"2024-09-19T07:07:15.060362+0000","last_fullsized":"2024-09-19T07:07:15.060362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062221+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:07:15.062221+0000","last_peered":"2024-09-19T07:07:15.062221+0000","last_clean":"2024-09-19T07:07:15.062221+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:07:15.062221+0000","last_undegraded":"2024-09-19T07:07:15.062221+0000","last_fullsized":"2024-09-19T07:07:15.062221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062339+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:07:15.062339+0000","last_peered":"2024-09-19T07:07:15.062339+0000","last_clean":"2024-09-19T07:07:15.062339+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:07:15.062339+0000","last_undegraded":"2024-09-19T07:07:15.062339+0000","last_fullsized":"2024-09-19T07:07:15.062339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056887+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:15.056887+0000","last_peered":"2024-09-19T07:07:15.056887+0000","last_clean":"2024-09-19T07:07:15.056887+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:15.056887+0000","last_undegraded":"2024-09-19T07:07:15.056887+0000","last_fullsized":"2024-09-19T07:07:15.056887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057741+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:15.057741+0000","last_peered":"2024-09-19T07:07:15.057741+0000","last_clean":"2024-09-19T07:07:15.057741+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:15.057741+0000","last_undegraded":"2024-09-19T07:07:15.057741+0000","last_fullsized":"2024-09-19T07:07:15.057741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056666+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:15.056666+0000","last_peered":"2024-09-19T07:07:15.056666+0000","last_clean":"2024-09-19T07:07:15.056666+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:15.056666+0000","last_undegraded":"2024-09-19T07:07:15.056666+0000","last_fullsized":"2024-09-19T07:07:15.056666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057025+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:15.057025+0000","last_peered":"2024-09-19T07:07:15.057025+0000","last_clean":"2024-09-19T07:07:15.057025+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:15.057025+0000","last_undegraded":"2024-09-19T07:07:15.057025+0000","last_fullsized":"2024-09-19T07:07:15.057025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056535+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:15.056535+0000","last_peered":"2024-09-19T07:07:15.056535+0000","last_clean":"2024-09-19T07:07:15.056535+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.056535+0000","last_undegraded":"2024-09-19T07:07:15.056535+0000","last_fullsized":"2024-09-19T07:07:15.056535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058690+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:15.058690+0000","last_peered":"2024-09-19T07:07:15.058690+0000","last_clean":"2024-09-19T07:07:15.058690+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:15.058690+0000","last_undegraded":"2024-09-19T07:07:15.058690+0000","last_fullsized":"2024-09-19T07:07:15.058690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059640+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:07:15.059640+0000","last_peered":"2024-09-19T07:07:15.059640+0000","last_clean":"2024-09-19T07:07:15.059640+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:07:15.059640+0000","last_undegraded":"2024-09-19T07:07:15.059640+0000","last_fullsized":"2024-09-19T07:07:15.059640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061668+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:07:15.061668+0000","last_peered":"2024-09-19T07:07:15.061668+0000","last_clean":"2024-09-19T07:07:15.061668+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:07:15.061668+0000","last_undegraded":"2024-09-19T07:07:15.061668+0000","last_fullsized":"2024-09-19T07:07:15.061668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057575+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057575+0000","last_peered":"2024-09-19T07:07:15.057575+0000","last_clean":"2024-09-19T07:07:15.057575+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057575+0000","last_undegraded":"2024-09-19T07:07:15.057575+0000","last_fullsized":"2024-09-19T07:07:15.057575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086015+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:15.086015+0000","last_peered":"2024-09-19T07:07:15.086015+0000","last_clean":"2024-09-19T07:07:15.086015+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:15.086015+0000","last_undegraded":"2024-09-19T07:07:15.086015+0000","last_fullsized":"2024-09-19T07:07:15.086015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058713+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:15.058713+0000","last_peered":"2024-09-19T07:07:15.058713+0000","last_clean":"2024-09-19T07:07:15.058713+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:15.058713+0000","last_undegraded":"2024-09-19T07:07:15.058713+0000","last_fullsized":"2024-09-19T07:07:15.058713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177840+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:15.177840+0000","last_peered":"2024-09-19T07:07:15.177840+0000","last_clean":"2024-09-19T07:07:15.177840+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:15.177840+0000","last_undegraded":"2024-09-19T07:07:15.177840+0000","last_fullsized":"2024-09-19T07:07:15.177840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067483+0000","last_change":"2024-09-19T07:07:15.067483+0000","last_active":"2024-09-19T07:07:15.067483+0000","last_peered":"2024-09-19T07:07:15.067483+0000","last_clean":"2024-09-19T07:07:15.067483+0000","last_became_active":"2024-09-19T07:07:15.064076+0000","last_became_peered":"2024-09-19T07:07:15.064076+0000","last_unstale":"2024-09-19T07:07:15.067483+0000","last_undegraded":"2024-09-19T07:07:15.067483+0000","last_fullsized":"2024-09-19T07:07:15.067483+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:42.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057614+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:15.057614+0000","last_peered":"2024-09-19T07:07:15.057614+0000","last_clean":"2024-09-19T07:07:15.057614+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:15.057614+0000","last_undegraded":"2024-09-19T07:07:15.057614+0000","last_fullsized":"2024-09-19T07:07:15.057614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063452+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:07:15.063452+0000","last_peered":"2024-09-19T07:07:15.063452+0000","last_clean":"2024-09-19T07:07:15.063452+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:07:15.063452+0000","last_undegraded":"2024-09-19T07:07:15.063452+0000","last_fullsized":"2024-09-19T07:07:15.063452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.070425+0000","last_change":"2024-09-19T07:07:15.069990+0000","last_active":"2024-09-19T07:07:15.070425+0000","last_peered":"2024-09-19T07:07:15.070425+0000","last_clean":"2024-09-19T07:07:15.070425+0000","last_became_active":"2024-09-19T07:07:15.064494+0000","last_became_peered":"2024-09-19T07:07:15.064494+0000","last_unstale":"2024-09-19T07:07:15.070425+0000","last_undegraded":"2024-09-19T07:07:15.070425+0000","last_fullsized":"2024-09-19T07:07:15.070425+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:45.233325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057683+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:15.057683+0000","last_peered":"2024-09-19T07:07:15.057683+0000","last_clean":"2024-09-19T07:07:15.057683+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:15.057683+0000","last_undegraded":"2024-09-19T07:07:15.057683+0000","last_fullsized":"2024-09-19T07:07:15.057683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057775+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:15.057775+0000","last_peered":"2024-09-19T07:07:15.057775+0000","last_clean":"2024-09-19T07:07:15.057775+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:15.057775+0000","last_undegraded":"2024-09-19T07:07:15.057775+0000","last_fullsized":"2024-09-19T07:07:15.057775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062951+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:07:15.062951+0000","last_peered":"2024-09-19T07:07:15.062951+0000","last_clean":"2024-09-19T07:07:15.062951+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:07:15.062951+0000","last_undegraded":"2024-09-19T07:07:15.062951+0000","last_fullsized":"2024-09-19T07:07:15.062951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057175+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:15.057175+0000","last_peered":"2024-09-19T07:07:15.057175+0000","last_clean":"2024-09-19T07:07:15.057175+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:15.057175+0000","last_undegraded":"2024-09-19T07:07:15.057175+0000","last_fullsized":"2024-09-19T07:07:15.057175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060703+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:07:15.060703+0000","last_peered":"2024-09-19T07:07:15.060703+0000","last_clean":"2024-09-19T07:07:15.060703+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:07:15.060703+0000","last_undegraded":"2024-09-19T07:07:15.060703+0000","last_fullsized":"2024-09-19T07:07:15.060703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061227+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:07:15.061227+0000","last_peered":"2024-09-19T07:07:15.061227+0000","last_clean":"2024-09-19T07:07:15.061227+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:07:15.061227+0000","last_undegraded":"2024-09-19T07:07:15.061227+0000","last_fullsized":"2024-09-19T07:07:15.061227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057997+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:15.057997+0000","last_peered":"2024-09-19T07:07:15.057997+0000","last_clean":"2024-09-19T07:07:15.057997+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:15.057997+0000","last_undegraded":"2024-09-19T07:07:15.057997+0000","last_fullsized":"2024-09-19T07:07:15.057997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062190+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:07:15.062190+0000","last_peered":"2024-09-19T07:07:15.062190+0000","last_clean":"2024-09-19T07:07:15.062190+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:07:15.062190+0000","last_undegraded":"2024-09-19T07:07:15.062190+0000","last_fullsized":"2024-09-19T07:07:15.062190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056695+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:15.056695+0000","last_peered":"2024-09-19T07:07:15.056695+0000","last_clean":"2024-09-19T07:07:15.056695+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:15.056695+0000","last_undegraded":"2024-09-19T07:07:15.056695+0000","last_fullsized":"2024-09-19T07:07:15.056695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058263+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:15.058263+0000","last_peered":"2024-09-19T07:07:15.058263+0000","last_clean":"2024-09-19T07:07:15.058263+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:15.058263+0000","last_undegraded":"2024-09-19T07:07:15.058263+0000","last_fullsized":"2024-09-19T07:07:15.058263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064712+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:07:15.064712+0000","last_peered":"2024-09-19T07:07:15.064712+0000","last_clean":"2024-09-19T07:07:15.064712+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:07:15.064712+0000","last_undegraded":"2024-09-19T07:07:15.064712+0000","last_fullsized":"2024-09-19T07:07:15.064712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'30","reported_seq":126,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:27.058107+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:07:27.058107+0000","last_peered":"2024-09-19T07:07:27.058107+0000","last_clean":"2024-09-19T07:07:27.058107+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:07:27.058107+0000","last_undegraded":"2024-09-19T07:07:27.058107+0000","last_fullsized":"2024-09-19T07:07:27.058107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":62,"num_read_kb":93,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060105+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:07:15.060105+0000","last_peered":"2024-09-19T07:07:15.060105+0000","last_clean":"2024-09-19T07:07:15.060105+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:07:15.060105+0000","last_undegraded":"2024-09-19T07:07:15.060105+0000","last_fullsized":"2024-09-19T07:07:15.060105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086241+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:15.086241+0000","last_peered":"2024-09-19T07:07:15.086241+0000","last_clean":"2024-09-19T07:07:15.086241+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.086241+0000","last_undegraded":"2024-09-19T07:07:15.086241+0000","last_fullsized":"2024-09-19T07:07:15.086241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058608+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:15.058608+0000","last_peered":"2024-09-19T07:07:15.058608+0000","last_clean":"2024-09-19T07:07:15.058608+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:15.058608+0000","last_undegraded":"2024-09-19T07:07:15.058608+0000","last_fullsized":"2024-09-19T07:07:15.058608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061390+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:07:15.061390+0000","last_peered":"2024-09-19T07:07:15.061390+0000","last_clean":"2024-09-19T07:07:15.061390+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:07:15.061390+0000","last_undegraded":"2024-09-19T07:07:15.061390+0000","last_fullsized":"2024-09-19T07:07:15.061390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178243+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:15.178243+0000","last_peered":"2024-09-19T07:07:15.178243+0000","last_clean":"2024-09-19T07:07:15.178243+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:15.178243+0000","last_undegraded":"2024-09-19T07:07:15.178243+0000","last_fullsized":"2024-09-19T07:07:15.178243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059369+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:07:15.059369+0000","last_peered":"2024-09-19T07:07:15.059369+0000","last_clean":"2024-09-19T07:07:15.059369+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:07:15.059369+0000","last_undegraded":"2024-09-19T07:07:15.059369+0000","last_fullsized":"2024-09-19T07:07:15.059369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086511+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:15.086511+0000","last_peered":"2024-09-19T07:07:15.086511+0000","last_clean":"2024-09-19T07:07:15.086511+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:15.086511+0000","last_undegraded":"2024-09-19T07:07:15.086511+0000","last_fullsized":"2024-09-19T07:07:15.086511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062233+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:07:15.062233+0000","last_peered":"2024-09-19T07:07:15.062233+0000","last_clean":"2024-09-19T07:07:15.062233+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:07:15.062233+0000","last_undegraded":"2024-09-19T07:07:15.062233+0000","last_fullsized":"2024-09-19T07:07:15.062233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059669+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:07:15.059669+0000","last_peered":"2024-09-19T07:07:15.059669+0000","last_clean":"2024-09-19T07:07:15.059669+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:07:15.059669+0000","last_undegraded":"2024-09-19T07:07:15.059669+0000","last_fullsized":"2024-09-19T07:07:15.059669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177946+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:15.177946+0000","last_peered":"2024-09-19T07:07:15.177946+0000","last_clean":"2024-09-19T07:07:15.177946+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:15.177946+0000","last_undegraded":"2024-09-19T07:07:15.177946+0000","last_fullsized":"2024-09-19T07:07:15.177946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059855+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:07:15.059855+0000","last_peered":"2024-09-19T07:07:15.059855+0000","last_clean":"2024-09-19T07:07:15.059855+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:07:15.059855+0000","last_undegraded":"2024-09-19T07:07:15.059855+0000","last_fullsized":"2024-09-19T07:07:15.059855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057987+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:15.057987+0000","last_peered":"2024-09-19T07:07:15.057987+0000","last_clean":"2024-09-19T07:07:15.057987+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:15.057987+0000","last_undegraded":"2024-09-19T07:07:15.057987+0000","last_fullsized":"2024-09-19T07:07:15.057987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179142+0000","last_change":"2024-09-19T07:07:15.179142+0000","last_active":"2024-09-19T07:07:15.179142+0000","last_peered":"2024-09-19T07:07:15.179142+0000","last_clean":"2024-09-19T07:07:15.179142+0000","last_became_active":"2024-09-19T07:07:15.178586+0000","last_became_peered":"2024-09-19T07:07:15.178586+0000","last_unstale":"2024-09-19T07:07:15.179142+0000","last_undegraded":"2024-09-19T07:07:15.179142+0000","last_fullsized":"2024-09-19T07:07:15.179142+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:24.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059113+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:07:15.059113+0000","last_peered":"2024-09-19T07:07:15.059113+0000","last_clean":"2024-09-19T07:07:15.059113+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:07:15.059113+0000","last_undegraded":"2024-09-19T07:07:15.059113+0000","last_fullsized":"2024-09-19T07:07:15.059113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056560+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:15.056560+0000","last_peered":"2024-09-19T07:07:15.056560+0000","last_clean":"2024-09-19T07:07:15.056560+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:15.056560+0000","last_undegraded":"2024-09-19T07:07:15.056560+0000","last_fullsized":"2024-09-19T07:07:15.056560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061522+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:07:15.061522+0000","last_peered":"2024-09-19T07:07:15.061522+0000","last_clean":"2024-09-19T07:07:15.061522+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:07:15.061522+0000","last_undegraded":"2024-09-19T07:07:15.061522+0000","last_fullsized":"2024-09-19T07:07:15.061522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058324+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:15.058324+0000","last_peered":"2024-09-19T07:07:15.058324+0000","last_clean":"2024-09-19T07:07:15.058324+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:15.058324+0000","last_undegraded":"2024-09-19T07:07:15.058324+0000","last_fullsized":"2024-09-19T07:07:15.058324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058457+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:15.058457+0000","last_peered":"2024-09-19T07:07:15.058457+0000","last_clean":"2024-09-19T07:07:15.058457+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:15.058457+0000","last_undegraded":"2024-09-19T07:07:15.058457+0000","last_fullsized":"2024-09-19T07:07:15.058457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062435+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:07:15.062435+0000","last_peered":"2024-09-19T07:07:15.062435+0000","last_clean":"2024-09-19T07:07:15.062435+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:07:15.062435+0000","last_undegraded":"2024-09-19T07:07:15.062435+0000","last_fullsized":"2024-09-19T07:07:15.062435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064296+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:07:15.064296+0000","last_peered":"2024-09-19T07:07:15.064296+0000","last_clean":"2024-09-19T07:07:15.064296+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:07:15.064296+0000","last_undegraded":"2024-09-19T07:07:15.064296+0000","last_fullsized":"2024-09-19T07:07:15.064296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177982+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:15.177982+0000","last_peered":"2024-09-19T07:07:15.177982+0000","last_clean":"2024-09-19T07:07:15.177982+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:15.177982+0000","last_undegraded":"2024-09-19T07:07:15.177982+0000","last_fullsized":"2024-09-19T07:07:15.177982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057006+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:15.057006+0000","last_peered":"2024-09-19T07:07:15.057006+0000","last_clean":"2024-09-19T07:07:15.057006+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:15.057006+0000","last_undegraded":"2024-09-19T07:07:15.057006+0000","last_fullsized":"2024-09-19T07:07:15.057006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063399+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:07:15.063399+0000","last_peered":"2024-09-19T07:07:15.063399+0000","last_clean":"2024-09-19T07:07:15.063399+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:07:15.063399+0000","last_undegraded":"2024-09-19T07:07:15.063399+0000","last_fullsized":"2024-09-19T07:07:15.063399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057769+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:15.057769+0000","last_peered":"2024-09-19T07:07:15.057769+0000","last_clean":"2024-09-19T07:07:15.057769+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:15.057769+0000","last_undegraded":"2024-09-19T07:07:15.057769+0000","last_fullsized":"2024-09-19T07:07:15.057769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059836+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:07:15.059836+0000","last_peered":"2024-09-19T07:07:15.059836+0000","last_clean":"2024-09-19T07:07:15.059836+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:07:15.059836+0000","last_undegraded":"2024-09-19T07:07:15.059836+0000","last_fullsized":"2024-09-19T07:07:15.059836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086193+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:15.086193+0000","last_peered":"2024-09-19T07:07:15.086193+0000","last_clean":"2024-09-19T07:07:15.086193+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:15.086193+0000","last_undegraded":"2024-09-19T07:07:15.086193+0000","last_fullsized":"2024-09-19T07:07:15.086193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056901+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:15.056901+0000","last_peered":"2024-09-19T07:07:15.056901+0000","last_clean":"2024-09-19T07:07:15.056901+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:15.056901+0000","last_undegraded":"2024-09-19T07:07:15.056901+0000","last_fullsized":"2024-09-19T07:07:15.056901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061870+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:07:15.061870+0000","last_peered":"2024-09-19T07:07:15.061870+0000","last_clean":"2024-09-19T07:07:15.061870+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:07:15.061870+0000","last_undegraded":"2024-09-19T07:07:15.061870+0000","last_fullsized":"2024-09-19T07:07:15.061870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060878+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:07:15.060878+0000","last_peered":"2024-09-19T07:07:15.060878+0000","last_clean":"2024-09-19T07:07:15.060878+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:07:15.060878+0000","last_undegraded":"2024-09-19T07:07:15.060878+0000","last_fullsized":"2024-09-19T07:07:15.060878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063278+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:07:15.063278+0000","last_peered":"2024-09-19T07:07:15.063278+0000","last_clean":"2024-09-19T07:07:15.063278+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:07:15.063278+0000","last_undegraded":"2024-09-19T07:07:15.063278+0000","last_fullsized":"2024-09-19T07:07:15.063278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.085854+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:15.085854+0000","last_peered":"2024-09-19T07:07:15.085854+0000","last_clean":"2024-09-19T07:07:15.085854+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:15.085854+0000","last_undegraded":"2024-09-19T07:07:15.085854+0000","last_fullsized":"2024-09-19T07:07:15.085854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177830+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:15.177830+0000","last_peered":"2024-09-19T07:07:15.177830+0000","last_clean":"2024-09-19T07:07:15.177830+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:15.177830+0000","last_undegraded":"2024-09-19T07:07:15.177830+0000","last_fullsized":"2024-09-19T07:07:15.177830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177571+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:15.177571+0000","last_peered":"2024-09-19T07:07:15.177571+0000","last_clean":"2024-09-19T07:07:15.177571+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:15.177571+0000","last_undegraded":"2024-09-19T07:07:15.177571+0000","last_fullsized":"2024-09-19T07:07:15.177571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056875+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:15.056875+0000","last_peered":"2024-09-19T07:07:15.056875+0000","last_clean":"2024-09-19T07:07:15.056875+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:15.056875+0000","last_undegraded":"2024-09-19T07:07:15.056875+0000","last_fullsized":"2024-09-19T07:07:15.056875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061384+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:07:15.061384+0000","last_peered":"2024-09-19T07:07:15.061384+0000","last_clean":"2024-09-19T07:07:15.061384+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:07:15.061384+0000","last_undegraded":"2024-09-19T07:07:15.061384+0000","last_fullsized":"2024-09-19T07:07:15.061384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067182+0000","last_change":"2024-09-19T07:07:15.067182+0000","last_active":"2024-09-19T07:07:15.067182+0000","last_peered":"2024-09-19T07:07:15.067182+0000","last_clean":"2024-09-19T07:07:15.067182+0000","last_became_active":"2024-09-19T07:07:15.066805+0000","last_became_peered":"2024-09-19T07:07:15.066805+0000","last_unstale":"2024-09-19T07:07:15.067182+0000","last_undegraded":"2024-09-19T07:07:15.067182+0000","last_fullsized":"2024-09-19T07:07:15.067182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:05.606025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086686+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:15.086686+0000","last_peered":"2024-09-19T07:07:15.086686+0000","last_clean":"2024-09-19T07:07:15.086686+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:15.086686+0000","last_undegraded":"2024-09-19T07:07:15.086686+0000","last_fullsized":"2024-09-19T07:07:15.086686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059089+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:07:15.059089+0000","last_peered":"2024-09-19T07:07:15.059089+0000","last_clean":"2024-09-19T07:07:15.059089+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:07:15.059089+0000","last_undegraded":"2024-09-19T07:07:15.059089+0000","last_fullsized":"2024-09-19T07:07:15.059089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061406+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:07:15.061406+0000","last_peered":"2024-09-19T07:07:15.061406+0000","last_clean":"2024-09-19T07:07:15.061406+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:07:15.061406+0000","last_undegraded":"2024-09-19T07:07:15.061406+0000","last_fullsized":"2024-09-19T07:07:15.061406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064389+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:07:15.064389+0000","last_peered":"2024-09-19T07:07:15.064389+0000","last_clean":"2024-09-19T07:07:15.064389+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:07:15.064389+0000","last_undegraded":"2024-09-19T07:07:15.064389+0000","last_fullsized":"2024-09-19T07:07:15.064389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061304+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:07:15.061304+0000","last_peered":"2024-09-19T07:07:15.061304+0000","last_clean":"2024-09-19T07:07:15.061304+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:07:15.061304+0000","last_undegraded":"2024-09-19T07:07:15.061304+0000","last_fullsized":"2024-09-19T07:07:15.061304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177882+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:15.177882+0000","last_peered":"2024-09-19T07:07:15.177882+0000","last_clean":"2024-09-19T07:07:15.177882+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:15.177882+0000","last_undegraded":"2024-09-19T07:07:15.177882+0000","last_fullsized":"2024-09-19T07:07:15.177882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178041+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:15.178041+0000","last_peered":"2024-09-19T07:07:15.178041+0000","last_clean":"2024-09-19T07:07:15.178041+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:15.178041+0000","last_undegraded":"2024-09-19T07:07:15.178041+0000","last_fullsized":"2024-09-19T07:07:15.178041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062462+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:07:15.062462+0000","last_peered":"2024-09-19T07:07:15.062462+0000","last_clean":"2024-09-19T07:07:15.062462+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:07:15.062462+0000","last_undegraded":"2024-09-19T07:07:15.062462+0000","last_fullsized":"2024-09-19T07:07:15.062462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":67,"num_read_kb":98,"num_write":85,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743454,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1154600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906978,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1024000,"data_stored":509301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168618,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":504623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561074,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1622016,"data_stored":1095173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":500631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":564072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":564620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1015808,"data_stored":500617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:07:29.682 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:07:29.683 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T07:07:29.683 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T07:07:29.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:29 smithi029 ceph-mon[31255]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 50 B/s, 0 objects/s recovering 2024-09-19T07:07:29.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:29 smithi078 ceph-mon[34556]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 50 B/s, 0 objects/s recovering 2024-09-19T07:07:29.947 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:29 smithi046 ceph-mon[34147]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 50 B/s, 0 objects/s recovering 2024-09-19T07:07:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 -- 172.21.15.29:0/4064126283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb701026a0 msgr2=0x7fdb70104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 --2- 172.21.15.29:0/4064126283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb701026a0 0x7fdb70104a90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009900 tx=0x7fdb6c02a410 comp rx=0 tx=0).stop 2024-09-19T07:07:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 -- 172.21.15.29:0/4064126283 shutdown_connections 2024-09-19T07:07:30.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 --2- 172.21.15.29:0/4064126283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70107900 0x7fdb70109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 --2- 172.21.15.29:0/4064126283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb70104fd0 0x7fdb701073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 --2- 172.21.15.29:0/4064126283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb701026a0 0x7fdb70104a90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 -- 172.21.15.29:0/4064126283 >> 172.21.15.29:0/4064126283 conn(0x7fdb700fc2a0 msgr2=0x7fdb700fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 -- 172.21.15.29:0/4064126283 shutdown_connections 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.503+0000 7fdb77815640 1 -- 172.21.15.29:0/4064126283 wait complete. 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 Processor -- start 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 -- start start 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701026a0 0x7fdb70197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:30.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70104fd0 0x7fdb701983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 0x7fdb7019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d760 con 0x7fdb70107900 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d5e0 con 0x7fdb701026a0 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb77815640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d8e0 con 0x7fdb70104fd0 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb75db2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 0x7fdb7019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb75db2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 0x7fdb7019f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58280/0 (socket says 172.21.15.29:58280) 2024-09-19T07:07:30.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb75db2640 1 -- 172.21.15.29:0/1199857465 learned_addr learned my addr 172.21.15.29:0/1199857465 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb74db0640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70104fd0 0x7fdb701983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.504+0000 7fdb755b1640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701026a0 0x7fdb70197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb75db2640 1 -- 172.21.15.29:0/1199857465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70104fd0 msgr2=0x7fdb701983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb75db2640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70104fd0 0x7fdb701983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb75db2640 1 -- 172.21.15.29:0/1199857465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701026a0 msgr2=0x7fdb70197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb75db2640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701026a0 0x7fdb70197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb75db2640 1 -- 172.21.15.29:0/1199857465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7019fad0 con 0x7fdb70107900 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb75db2640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 0x7fdb7019f460 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800cad0 tx=0x7fdb6800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800ae20 con 0x7fdb70107900 2024-09-19T07:07:30.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb68005020 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7019fdc0 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800f6b0 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.505+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a0270 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.506+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb700fdd90 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.507+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb680051d0 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.508+0000 7fdb667fc640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3380 0x7fdb5c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.508+0000 7fdb755b1640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3380 0x7fdb5c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.508+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fdb680d0060 con 0x7fdb70107900 2024-09-19T07:07:30.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.509+0000 7fdb755b1640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3380 0x7fdb5c0a5840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000c00 tx=0x7fdb6c005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:30.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.511+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb68014030 con 0x7fdb70107900 2024-09-19T07:07:30.700 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:30 smithi029 ceph-mon[31255]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:30.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.759+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdb7002d7c0 con 0x7fdb70107900 2024-09-19T07:07:30.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.761+0000 7fdb667fc640 1 -- 172.21.15.29:0/1199857465 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fdb6809c2f0 con 0x7fdb70107900 2024-09-19T07:07:30.762 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-09-19T07:07:30.762 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCyzetmiv9ZLRAApT7O86+qf/zq4jOxkTVFGw== 2024-09-19T07:07:30.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.763+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3380 msgr2=0x7fdb5c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:30.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.763+0000 7fdb77815640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3380 0x7fdb5c0a5840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c000c00 tx=0x7fdb6c005e40 comp rx=0 tx=0).stop 2024-09-19T07:07:30.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.763+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 msgr2=0x7fdb7019f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:30.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.763+0000 7fdb77815640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 0x7fdb7019f460 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800cad0 tx=0x7fdb6800cf90 comp rx=0 tx=0).stop 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 shutdown_connections 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107900 0x7fdb7019f460 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3380 0x7fdb5c0a5840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70104fd0 0x7fdb701983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 --2- 172.21.15.29:0/1199857465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701026a0 0x7fdb70197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 >> 172.21.15.29:0/1199857465 conn(0x7fdb700fc2a0 msgr2=0x7fdb70103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 shutdown_connections 2024-09-19T07:07:30.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:30.764+0000 7fdb77815640 1 -- 172.21.15.29:0/1199857465 wait complete. 2024-09-19T07:07:30.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:30 smithi078 ceph-mon[34556]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:30.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:30 smithi046 ceph-mon[34147]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:07:31.505 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:07:31.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T07:07:31.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T07:07:31.547 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T07:07:31.547 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T07:07:31.548 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T07:07:31.843 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:31.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:31 smithi029 ceph-mon[31255]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T07:07:31.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:31 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1199857465' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:07:31.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:31 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1199857465' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:07:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:31 smithi078 ceph-mon[34556]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T07:07:31.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:31 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1199857465' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:07:31.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:31 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1199857465' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:07:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:31 smithi046 ceph-mon[34147]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T07:07:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:31 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1199857465' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:07:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:31 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1199857465' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:07:32.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 -- 172.21.15.29:0/2234016615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28102790 msgr2=0x7fad281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:32.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 --2- 172.21.15.29:0/2234016615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28102790 0x7fad281067e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fad18009900 tx=0x7fad1802a410 comp rx=0 tx=0).stop 2024-09-19T07:07:32.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 -- 172.21.15.29:0/2234016615 shutdown_connections 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 --2- 172.21.15.29:0/2234016615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad28106f10 0x7fad2810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 --2- 172.21.15.29:0/2234016615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28102790 0x7fad281067e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 --2- 172.21.15.29:0/2234016615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad28101de0 0x7fad281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 -- 172.21.15.29:0/2234016615 >> 172.21.15.29:0/2234016615 conn(0x7fad280fd8c0 msgr2=0x7fad280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 -- 172.21.15.29:0/2234016615 shutdown_connections 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.373+0000 7fad2f9af640 1 -- 172.21.15.29:0/2234016615 wait complete. 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.374+0000 7fad2f9af640 1 Processor -- start 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.374+0000 7fad2f9af640 1 -- start start 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2f9af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad28101de0 0x7fad281983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2f9af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad28102790 0x7fad28198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2f9af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 0x7fad2819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:32.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2f9af640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fad28111e40 con 0x7fad28106f10 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2f9af640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fad28111cc0 con 0x7fad28102790 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2f9af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad28111fc0 con 0x7fad28101de0 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 0x7fad2819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 0x7fad2819cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58302/0 (socket says 172.21.15.29:58302) 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 -- 172.21.15.29:0/4249361763 learned_addr learned my addr 172.21.15.29:0/4249361763 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2cf4a640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad28102790 0x7fad28198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2d74b640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad28101de0 0x7fad281983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 -- 172.21.15.29:0/4249361763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad28101de0 msgr2=0x7fad281983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad28101de0 0x7fad281983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 -- 172.21.15.29:0/4249361763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad28102790 msgr2=0x7fad28198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad28102790 0x7fad28198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 -- 172.21.15.29:0/4249361763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2819d370 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.375+0000 7fad2df4c640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 0x7fad2819cc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b970 tx=0x7fad2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.376+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20019070 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.376+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fad20014440 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.376+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2819d660 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.376+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad200075d0 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.376+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad281a4f40 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.377+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad281021c0 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.378+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fad2001c070 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.379+0000 7fad1e7fc640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad140a3350 0x7fad140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.379+0000 7fad2d74b640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad140a3350 0x7fad140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.379+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fad200cf240 con 0x7fad28106f10 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.379+0000 7fad2d74b640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad140a3350 0x7fad140a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad240058c0 tx=0x7fad2400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:32.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.383+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad2009b560 con 0x7fad28106f10 2024-09-19T07:07:32.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.606+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fad28109bc0 con 0x7fad28106f10 2024-09-19T07:07:32.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.611+0000 7fad1e7fc640 1 -- 172.21.15.29:0/4249361763 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264048 (secure 0 0 0) 0x7fad2009f860 con 0x7fad28106f10 2024-09-19T07:07:32.615 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad140a3350 msgr2=0x7fad140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad140a3350 0x7fad140a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad240058c0 tx=0x7fad2400a4c0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 msgr2=0x7fad2819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 0x7fad2819cc90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b970 tx=0x7fad2000be30 comp rx=0 tx=0).stop 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 shutdown_connections 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad28106f10 0x7fad2819cc90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad28102790 0x7fad28198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fad140a3350 0x7fad140a5810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 --2- 172.21.15.29:0/4249361763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad28101de0 0x7fad281983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 >> 172.21.15.29:0/4249361763 conn(0x7fad280fd8c0 msgr2=0x7fad280fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 shutdown_connections 2024-09-19T07:07:32.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:32.615+0000 7fad2f9af640 1 -- 172.21.15.29:0/4249361763 wait complete. 2024-09-19T07:07:33.335 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":3056547780},{"type":"v1","addr":"172.21.15.29:6801","nonce":3056547780}]},"active_addr":"172.21.15.29:6801/3056547780","active_change":"2024-09-19T06:59:13.753573+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.29:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":2560148104}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":482868887}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":819719028}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":3214920861}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.29:0","nonce":4238818680}]}]} 2024-09-19T07:07:33.342 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T07:07:33.342 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T07:07:33.342 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:07:33.603 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:33.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:33 smithi029 ceph-mon[31255]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T07:07:33.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:33 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4249361763' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:07:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:33 smithi078 ceph-mon[34556]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T07:07:33.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:33 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4249361763' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:07:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:33 smithi046 ceph-mon[34147]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T07:07:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:33 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4249361763' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:07:34.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 -- 172.21.15.29:0/3125524707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc103660 msgr2=0x7f6bdc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 --2- 172.21.15.29:0/3125524707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc103660 0x7f6bdc10bb50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009900 tx=0x7f6bc402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 -- 172.21.15.29:0/3125524707 shutdown_connections 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 --2- 172.21.15.29:0/3125524707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc10c170 0x7f6bdc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 --2- 172.21.15.29:0/3125524707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc103660 0x7f6bdc10bb50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 --2- 172.21.15.29:0/3125524707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 0x7f6bdc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 -- 172.21.15.29:0/3125524707 >> 172.21.15.29:0/3125524707 conn(0x7f6bdc0fc7a0 msgr2=0x7f6bdc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 -- 172.21.15.29:0/3125524707 shutdown_connections 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.101+0000 7f6be281c640 1 -- 172.21.15.29:0/3125524707 wait complete. 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 Processor -- start 2024-09-19T07:07:34.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 -- start start 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 0x7f6bdc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc103660 0x7f6bdc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 0x7f6bdc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc111e70 con 0x7f6bdc10c170 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc111cf0 con 0x7f6bdc102d40 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be281c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc111ff0 con 0x7f6bdc103660 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be0db9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 0x7f6bdc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be0db9640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 0x7f6bdc101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:58322/0 (socket says 172.21.15.29:58322) 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.102+0000 7f6be0db9640 1 -- 172.21.15.29:0/3613779714 learned_addr learned my addr 172.21.15.29:0/3613779714 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bdbfff640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 0x7f6bdc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bd3fff640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc103660 0x7f6bdc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:34.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be0db9640 1 -- 172.21.15.29:0/3613779714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc103660 msgr2=0x7f6bdc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be0db9640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc103660 0x7f6bdc100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be0db9640 1 -- 172.21.15.29:0/3613779714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 msgr2=0x7f6bdc1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be0db9640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 0x7f6bdc1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be0db9640 1 -- 172.21.15.29:0/3613779714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc1a6860 con 0x7f6bdc10c170 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bdbfff640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 0x7f6bdc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bd3fff640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc103660 0x7f6bdc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be0db9640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 0x7f6bdc101420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400cad0 tx=0x7f6bd400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400ae20 con 0x7f6bdc10c170 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6bd4005020 con 0x7f6bdc10c170 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bdc1a6b50 con 0x7f6bdc10c170 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400f6b0 con 0x7f6bdc10c170 2024-09-19T07:07:34.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.103+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bdc1a7090 con 0x7f6bdc10c170 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.104+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bdc103120 con 0x7f6bdc10c170 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.106+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6bd40051d0 con 0x7f6bdc10c170 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.106+0000 7f6bd9ffb640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6bc80a3350 0x7f6bc80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.106+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f6bd40d01a0 con 0x7f6bdc10c170 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.106+0000 7f6bdbfff640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6bc80a3350 0x7f6bc80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.107+0000 7f6bdbfff640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6bc80a3350 0x7f6bc80a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009b50 tx=0x7f6bcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:34.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.109+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bd4014030 con 0x7f6bdc10c170 2024-09-19T07:07:34.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.288+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bdc101ed0 con 0x7f6bdc10c170 2024-09-19T07:07:34.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.290+0000 7f6bd9ffb640 1 -- 172.21.15.29:0/3613779714 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24654 (secure 0 0 0) 0x7f6bdc101ed0 con 0x7f6bdc10c170 2024-09-19T07:07:34.291 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:34.291 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":90,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:07:15.053626+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:07:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6bc80a3350 msgr2=0x7f6bc80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6bc80a3350 0x7f6bc80a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009b50 tx=0x7f6bcc005f90 comp rx=0 tx=0).stop 2024-09-19T07:07:34.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 msgr2=0x7f6bdc101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 0x7f6bdc101420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400cad0 tx=0x7f6bd400cf90 comp rx=0 tx=0).stop 2024-09-19T07:07:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 shutdown_connections 2024-09-19T07:07:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bdc10c170 0x7f6bdc101420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6bc80a3350 0x7f6bc80a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6bdc103660 0x7f6bdc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 --2- 172.21.15.29:0/3613779714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6bdc102d40 0x7f6bdc1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 >> 172.21.15.29:0/3613779714 conn(0x7f6bdc0fc7a0 msgr2=0x7f6bdc0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 shutdown_connections 2024-09-19T07:07:34.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:34.292+0000 7f6be281c640 1 -- 172.21.15.29:0/3613779714 wait complete. 2024-09-19T07:07:34.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:34 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3613779714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:34.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:34 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3613779714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:34.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:34 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3613779714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:35.066 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T07:07:35.066 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:07:35.325 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:35.748 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:35 smithi029 ceph-mon[31255]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T07:07:35.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 -- 172.21.15.29:0/2442130640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc103660 msgr2=0x7fd9dc10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/2442130640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc103660 0x7fd9dc10bb50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009900 tx=0x7fd9d002a480 comp rx=0 tx=0).stop 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 -- 172.21.15.29:0/2442130640 shutdown_connections 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/2442130640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc10c170 0x7fd9dc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/2442130640 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc103660 0x7fd9dc10bb50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/2442130640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9dc102d40 0x7fd9dc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 -- 172.21.15.29:0/2442130640 >> 172.21.15.29:0/2442130640 conn(0x7fd9dc0fc7a0 msgr2=0x7fd9dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 -- 172.21.15.29:0/2442130640 shutdown_connections 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.831+0000 7fd9e19ca640 1 -- 172.21.15.29:0/2442130640 wait complete. 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 Processor -- start 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 -- start start 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 0x7fd9dc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:35.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc103660 0x7fd9dc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9dc10c170 0x7fd9dc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc111e20 con 0x7fd9dc102d40 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc111ca0 con 0x7fd9dc10c170 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9e19ca640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9dc111fa0 con 0x7fd9dc103660 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.832+0000 7fd9daffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 0x7fd9dc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 0x7fd9dc1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44814/0 (socket says 172.21.15.29:44814) 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 -- 172.21.15.29:0/3844694622 learned_addr learned my addr 172.21.15.29:0/3844694622 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9db7fe640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9dc10c170 0x7fd9dc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9da7fc640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc103660 0x7fd9dc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 -- 172.21.15.29:0/3844694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc103660 msgr2=0x7fd9dc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc103660 0x7fd9dc100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 -- 172.21.15.29:0/3844694622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9dc10c170 msgr2=0x7fd9dc101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9dc10c170 0x7fd9dc101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 -- 172.21.15.29:0/3844694622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9dc1a6840 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9daffd640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 0x7fd9dc1009a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00e9f0 tx=0x7fd9cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00cd80 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd9cc0108e0 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.833+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc018920 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.834+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9dc1a6b30 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.834+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9dc1a6ff0 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.835+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9dc103120 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.836+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd9cc010a90 con 0x7fd9dc102d40 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.837+0000 7fd9e09c8640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd9c40a32d0 0x7fd9c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.837+0000 7fd9da7fc640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd9c40a32d0 0x7fd9c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:35.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.837+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fd9cc0d0130 con 0x7fd9dc102d40 2024-09-19T07:07:35.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.838+0000 7fd9da7fc640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd9c40a32d0 0x7fd9c40a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0031440 tx=0x7fd9d0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:35.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:35.842+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9cc09c2e0 con 0x7fd9dc102d40 2024-09-19T07:07:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:35 smithi078 ceph-mon[34556]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T07:07:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:35 smithi046 ceph-mon[34147]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-19T07:07:36.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.019+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9dc1071e0 con 0x7fd9dc102d40 2024-09-19T07:07:36.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.021+0000 7fd9e09c8640 1 -- 172.21.15.29:0/3844694622 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24654 (secure 0 0 0) 0x7fd9cc0a05e0 con 0x7fd9dc102d40 2024-09-19T07:07:36.022 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:07:36.022 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":90,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:07:15.053626+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:07:36.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd9c40a32d0 msgr2=0x7fd9c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:36.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd9c40a32d0 0x7fd9c40a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0031440 tx=0x7fd9d0005b50 comp rx=0 tx=0).stop 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 msgr2=0x7fd9dc1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 0x7fd9dc1009a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00e9f0 tx=0x7fd9cc00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 shutdown_connections 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9dc10c170 0x7fd9dc101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd9c40a32d0 0x7fd9c40a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9dc103660 0x7fd9dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 --2- 172.21.15.29:0/3844694622 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9dc102d40 0x7fd9dc1009a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 >> 172.21.15.29:0/3844694622 conn(0x7fd9dc0fc7a0 msgr2=0x7fd9dc0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 shutdown_connections 2024-09-19T07:07:36.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:36.023+0000 7fd9e19ca640 1 -- 172.21.15.29:0/3844694622 wait complete. 2024-09-19T07:07:36.745 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:36 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3844694622' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:36.783 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T07:07:36.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T07:07:36.784 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T07:07:36.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T07:07:36.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T07:07:36.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T07:07:36.786 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T07:07:36.786 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T07:07:36.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T07:07:36.787 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T07:07:36.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T07:07:36.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T07:07:36.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:36 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3844694622' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:36.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:36 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3844694622' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:07:37.564 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:37.852 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:37 smithi029 ceph-mon[31255]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:37 smithi078 ceph-mon[34556]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:37 smithi046 ceph-mon[34147]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 -- 172.21.15.29:0/1200557429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074f40 msgr2=0x7ff5c010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 --2- 172.21.15.29:0/1200557429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074f40 0x7ff5c010de80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009900 tx=0x7ff5b402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 -- 172.21.15.29:0/1200557429 shutdown_connections 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 --2- 172.21.15.29:0/1200557429 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c010e3c0 0x7ff5c0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 --2- 172.21.15.29:0/1200557429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074f40 0x7ff5c010de80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 --2- 172.21.15.29:0/1200557429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c0074620 0x7ff5c0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 -- 172.21.15.29:0/1200557429 >> 172.21.15.29:0/1200557429 conn(0x7ff5c00fd8c0 msgr2=0x7ff5c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 -- 172.21.15.29:0/1200557429 shutdown_connections 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.078+0000 7ff5c674a640 1 -- 172.21.15.29:0/1200557429 wait complete. 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 Processor -- start 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 -- start start 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074620 0x7ff5c019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c0074f40 0x7ff5c019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c010e3c0 0x7ff5c019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0113ff0 con 0x7ff5c0074620 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0113e70 con 0x7ff5c0074f40 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.079+0000 7ff5c674a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0114170 con 0x7ff5c010e3c0 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074620 0x7ff5c019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074620 0x7ff5c019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44832/0 (socket says 172.21.15.29:44832) 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 -- 172.21.15.29:0/328002002 learned_addr learned my addr 172.21.15.29:0/328002002 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5c4ce7640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c010e3c0 0x7ff5c019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bf7fe640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c0074f40 0x7ff5c019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 -- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c010e3c0 msgr2=0x7ff5c019ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c010e3c0 0x7ff5c019ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 -- 172.21.15.29:0/328002002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c0074f40 msgr2=0x7ff5c019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c0074f40 0x7ff5c019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 -- 172.21.15.29:0/328002002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c019f510 con 0x7ff5c0074620 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bf7fe640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c0074f40 0x7ff5c019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bffff640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074620 0x7ff5c019a560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e9f0 tx=0x7ff5b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b000cd80 con 0x7ff5c0074620 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c019f800 con 0x7ff5c0074620 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5b00108e0 con 0x7ff5c0074620 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c01a70e0 con 0x7ff5c0074620 2024-09-19T07:07:38.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.080+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b00188c0 con 0x7ff5c0074620 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.081+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5c0062980 con 0x7ff5c0074620 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff5b0010a90 con 0x7ff5c0074620 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bd7fa640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5a80a32d0 0x7ff5a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bf7fe640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5a80a32d0 0x7ff5a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7ff5b00d0600 con 0x7ff5c0074620 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bd7fa640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] conn(0x7ff5a80ae4a0 0x7ff5a80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 --> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5b000be50 con 0x7ff5a80ae4a0 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.083+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff5b00d0a50 con 0x7ff5c0074620 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.084+0000 7ff5bf7fe640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5a80a32d0 0x7ff5a80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4031440 tx=0x7ff5b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.084+0000 7ff5c4ce7640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] conn(0x7ff5a80ae4a0 0x7ff5a80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.084+0000 7ff5c4ce7640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] conn(0x7ff5a80ae4a0 0x7ff5a80b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:38.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.085+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== osd.2 v2:172.21.15.78:6800/2352788305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5b000be50 con 0x7ff5a80ae4a0 2024-09-19T07:07:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.099+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 --> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5c0062d80 con 0x7ff5a80ae4a0 2024-09-19T07:07:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5bd7fa640 1 -- 172.21.15.29:0/328002002 <== osd.2 v2:172.21.15.78:6800/2352788305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5c0062d80 con 0x7ff5a80ae4a0 2024-09-19T07:07:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] conn(0x7ff5a80ae4a0 msgr2=0x7ff5a80b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c674a640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] conn(0x7ff5a80ae4a0 0x7ff5a80b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5a80a32d0 msgr2=0x7ff5a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c674a640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5a80a32d0 0x7ff5a80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4031440 tx=0x7ff5b4005a20 comp rx=0 tx=0).stop 2024-09-19T07:07:38.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074620 msgr2=0x7ff5c019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c674a640 1 --2- 172.21.15.29:0/328002002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c0074620 0x7ff5c019a560 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff5b000e9f0 tx=0x7ff5b000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.100+0000 7ff5c4ce7640 1 -- 172.21.15.29:0/328002002 reap_dead start 2024-09-19T07:07:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.101+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 shutdown_connections 2024-09-19T07:07:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.101+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 >> 172.21.15.29:0/328002002 conn(0x7ff5c00fd8c0 msgr2=0x7ff5c00ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.101+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 shutdown_connections 2024-09-19T07:07:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:38.101+0000 7ff5c674a640 1 -- 172.21.15.29:0/328002002 wait complete. 2024-09-19T07:07:38.834 INFO:teuthology.orchestra.run.smithi029.stdout:77309411404 2024-09-19T07:07:38.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T07:07:38.843 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.843 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.856 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.861 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.865 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:38.875 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:39 smithi029 ceph-mon[31255]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:39 smithi078 ceph-mon[34556]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:39 smithi046 ceph-mon[34147]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:40.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 -- 172.21.15.29:0/2545495994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0102570 msgr2=0x7f18e01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:40.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 --2- 172.21.15.29:0/2545495994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0102570 0x7f18e01029b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009900 tx=0x7f18d402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:40.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 -- 172.21.15.29:0/2545495994 shutdown_connections 2024-09-19T07:07:40.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 --2- 172.21.15.29:0/2545495994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18e0102ef0 0x7f18e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 --2- 172.21.15.29:0/2545495994 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0102570 0x7f18e01029b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 --2- 172.21.15.29:0/2545495994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18e0100e20 0x7f18e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 -- 172.21.15.29:0/2545495994 >> 172.21.15.29:0/2545495994 conn(0x7f18e00fc7d0 msgr2=0x7f18e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 -- 172.21.15.29:0/2545495994 shutdown_connections 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 -- 172.21.15.29:0/2545495994 wait complete. 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.662+0000 7f18e5df6640 1 Processor -- start 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 -- start start 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0100e20 0x7f18e0199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18e0102570 0x7f18e0199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18e0102ef0 0x7f18e01a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0110e30 con 0x7f18e0100e20 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0110cb0 con 0x7f18e0102ef0 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18e5df6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0110fb0 con 0x7f18e0102570 2024-09-19T07:07:40.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0100e20 0x7f18e0199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0100e20 0x7f18e0199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44882/0 (socket says 172.21.15.29:44882) 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 -- 172.21.15.29:0/3013561907 learned_addr learned my addr 172.21.15.29:0/3013561907 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18deffd640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18e0102570 0x7f18e0199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18dffff640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18e0102ef0 0x7f18e01a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 -- 172.21.15.29:0/3013561907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18e0102570 msgr2=0x7f18e0199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18e0102570 0x7f18e0199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 -- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18e0102ef0 msgr2=0x7f18e01a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f18e0102ef0 0x7f18e01a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 -- 172.21.15.29:0/3013561907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e01a4800 con 0x7f18e0100e20 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.663+0000 7f18df7fe640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0100e20 0x7f18e0199240 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f18d000d770 tx=0x7f18d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.664+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0017070 con 0x7f18e0100e20 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.664+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e01a49d0 con 0x7f18e0100e20 2024-09-19T07:07:40.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.664+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f18d00054d0 con 0x7f18e0100e20 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.664+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0004cf0 con 0x7f18e0100e20 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.664+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e01a4e90 con 0x7f18e0100e20 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.665+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18e0062980 con 0x7f18e0100e20 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.666+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f18d0004e90 con 0x7f18e0100e20 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.666+0000 7f18dcff9640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f18c80a32d0 0x7f18c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18deffd640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f18c80a32d0 0x7f18c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f18d00cf820 con 0x7f18e0100e20 2024-09-19T07:07:40.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18dcff9640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] conn(0x7f18c80ae4a0 0x7f18c80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 --> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18d001ee50 con 0x7f18c80ae4a0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f18d00d6050 con 0x7f18e0100e20 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18deffd640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f18c80a32d0 0x7f18c80a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009230 tx=0x7f18d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18dffff640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] conn(0x7f18c80ae4a0 0x7f18c80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.667+0000 7f18dffff640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] conn(0x7f18c80ae4a0 0x7f18c80b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.668+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== osd.7 v2:172.21.15.46:6816/669772686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18d001ee50 con 0x7f18c80ae4a0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.682+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 --> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18e0062e30 con 0x7f18c80ae4a0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.682+0000 7f18dcff9640 1 -- 172.21.15.29:0/3013561907 <== osd.7 v2:172.21.15.46:6816/669772686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f18e0062e30 con 0x7f18c80ae4a0 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] conn(0x7f18c80ae4a0 msgr2=0x7f18c80b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] conn(0x7f18c80ae4a0 0x7f18c80b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f18c80a32d0 msgr2=0x7f18c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f18c80a32d0 0x7f18c80a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009230 tx=0x7f18d40058d0 comp rx=0 tx=0).stop 2024-09-19T07:07:40.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0100e20 msgr2=0x7f18e0199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:40.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 --2- 172.21.15.29:0/3013561907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e0100e20 0x7f18e0199240 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f18d000d770 tx=0x7f18d000dc30 comp rx=0 tx=0).stop 2024-09-19T07:07:40.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18dffff640 1 -- 172.21.15.29:0/3013561907 reap_dead start 2024-09-19T07:07:40.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 shutdown_connections 2024-09-19T07:07:40.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 >> 172.21.15.29:0/3013561907 conn(0x7f18e00fc7d0 msgr2=0x7f18e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:40.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 shutdown_connections 2024-09-19T07:07:40.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.683+0000 7f18e5df6640 1 -- 172.21.15.29:0/3013561907 wait complete. 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.322+0000 7fe8fa190640 1 -- 172.21.15.29:0/113358213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4100e20 msgr2=0x7fe8f4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.322+0000 7fe8fa190640 1 --2- 172.21.15.29:0/113358213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4100e20 0x7fe8f4101200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009900 tx=0x7fe8e402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.322+0000 7fe8fa190640 1 -- 172.21.15.29:0/113358213 shutdown_connections 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.322+0000 7fe8fa190640 1 --2- 172.21.15.29:0/113358213 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8f4102ef0 0x7fe8f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.322+0000 7fe8fa190640 1 --2- 172.21.15.29:0/113358213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8f4102570 0x7fe8f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.322+0000 7fe8fa190640 1 --2- 172.21.15.29:0/113358213 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4100e20 0x7fe8f4101200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.323+0000 7fe8fa190640 1 -- 172.21.15.29:0/113358213 >> 172.21.15.29:0/113358213 conn(0x7fe8f40fc7d0 msgr2=0x7fe8f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.323+0000 7fe8fa190640 1 -- 172.21.15.29:0/113358213 shutdown_connections 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.323+0000 7fe8fa190640 1 -- 172.21.15.29:0/113358213 wait complete. 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.323+0000 7fe8fa190640 1 Processor -- start 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.323+0000 7fe8fa190640 1 -- start start 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8fa190640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8f4100e20 0x7fe8f40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8fa190640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8f4102570 0x7fe8f40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8fa190640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4102ef0 0x7fe8f40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8fa190640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4110ed0 con 0x7fe8f4102ef0 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8fa190640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4110d50 con 0x7fe8f4100e20 2024-09-19T07:07:41.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8fa190640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f4111050 con 0x7fe8f4102570 2024-09-19T07:07:41.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4102ef0 0x7fe8f40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4102ef0 0x7fe8f40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44910/0 (socket says 172.21.15.29:44910) 2024-09-19T07:07:41.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 -- 172.21.15.29:0/2177043686 learned_addr learned my addr 172.21.15.29:0/2177043686 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:41.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f37fe640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8f4100e20 0x7fe8f40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f2ffd640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8f4102570 0x7fe8f40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 -- 172.21.15.29:0/2177043686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8f4102570 msgr2=0x7fe8f40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8f4102570 0x7fe8f40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 -- 172.21.15.29:0/2177043686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8f4100e20 msgr2=0x7fe8f40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8f4100e20 0x7fe8f40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 -- 172.21.15.29:0/2177043686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f41a6980 con 0x7fe8f4102ef0 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f37fe640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8f4100e20 0x7fe8f40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.324+0000 7fe8f3fff640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4102ef0 0x7fe8f40fd700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00b970 tx=0x7fe8ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.325+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec019070 con 0x7fe8f4102ef0 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.325+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f41a6c70 con 0x7fe8f4102ef0 2024-09-19T07:07:41.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.325+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe8ec014440 con 0x7fe8f4102ef0 2024-09-19T07:07:41.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.325+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0075d0 con 0x7fe8f4102ef0 2024-09-19T07:07:41.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.325+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f41a7160 con 0x7fe8f4102ef0 2024-09-19T07:07:41.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.326+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8f4062900 con 0x7fe8f4102ef0 2024-09-19T07:07:41.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.327+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe8ec01c070 con 0x7fe8f4102ef0 2024-09-19T07:07:41.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f0ff9640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe8dc0a32d0 0x7fe8dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fe8ec0cfb30 con 0x7fe8f4102ef0 2024-09-19T07:07:41.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f37fe640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe8dc0a32d0 0x7fe8dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f0ff9640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] conn(0x7fe8dc0ae4a0 0x7fe8dc0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 --> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8ec0047d0 con 0x7fe8dc0ae4a0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe8ec0cff80 con 0x7fe8f4102ef0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f2ffd640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] conn(0x7fe8dc0ae4a0 0x7fe8dc0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f37fe640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe8dc0a32d0 0x7fe8dc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4005ab0 tx=0x7fe8e4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.328+0000 7fe8f2ffd640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] conn(0x7fe8dc0ae4a0 0x7fe8dc0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.329+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== osd.3 v2:172.21.15.29:6810/1809490349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8ec0047d0 con 0x7fe8dc0ae4a0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 --> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8f4062d80 con 0x7fe8dc0ae4a0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8f0ff9640 1 -- 172.21.15.29:0/2177043686 <== osd.3 v2:172.21.15.29:6810/1809490349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe8f4062d80 con 0x7fe8dc0ae4a0 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] conn(0x7fe8dc0ae4a0 msgr2=0x7fe8dc0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] conn(0x7fe8dc0ae4a0 0x7fe8dc0b0940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe8dc0a32d0 msgr2=0x7fe8dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fe8dc0a32d0 0x7fe8dc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4005ab0 tx=0x7fe8e4005a20 comp rx=0 tx=0).stop 2024-09-19T07:07:41.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4102ef0 msgr2=0x7fe8f40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 --2- 172.21.15.29:0/2177043686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8f4102ef0 0x7fe8f40fd700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00b970 tx=0x7fe8ec00be30 comp rx=0 tx=0).stop 2024-09-19T07:07:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8f3fff640 1 -- 172.21.15.29:0/2177043686 reap_dead start 2024-09-19T07:07:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 shutdown_connections 2024-09-19T07:07:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.343+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 >> 172.21.15.29:0/2177043686 conn(0x7fe8f40fc7d0 msgr2=0x7fe8f406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.344+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 shutdown_connections 2024-09-19T07:07:41.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:41.344+0000 7fe8fa190640 1 -- 172.21.15.29:0/2177043686 wait complete. 2024-09-19T07:07:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 -- 172.21.15.29:0/4054640530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 msgr2=0x7fba64074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 --2- 172.21.15.29:0/4054640530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba64074970 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba60009ca0 tx=0x7fba6002a950 comp rx=0 tx=0).stop 2024-09-19T07:07:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 -- 172.21.15.29:0/4054640530 shutdown_connections 2024-09-19T07:07:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 --2- 172.21.15.29:0/4054640530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba64112b90 0x7fba64114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 --2- 172.21.15.29:0/4054640530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba64074eb0 0x7fba64112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 --2- 172.21.15.29:0/4054640530 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba64074970 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 -- 172.21.15.29:0/4054640530 >> 172.21.15.29:0/4054640530 conn(0x7fba640fd8c0 msgr2=0x7fba640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 -- 172.21.15.29:0/4054640530 shutdown_connections 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.548+0000 7fba6c04a640 1 -- 172.21.15.29:0/4054640530 wait complete. 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 Processor -- start 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 -- start start 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba641a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba64074eb0 0x7fba641a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba64112b90 0x7fba6419e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fba64118400 con 0x7fba64074590 2024-09-19T07:07:41.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fba64118280 con 0x7fba64112b90 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba6c04a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba64118580 con 0x7fba64074eb0 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba69de6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba641a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba69de6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba641a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44872/0 (socket says 172.21.15.29:44872) 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.549+0000 7fba69de6640 1 -- 172.21.15.29:0/23295293 learned_addr learned my addr 172.21.15.29:0/23295293 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba695e5640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba64074eb0 0x7fba641a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba6a5e7640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba64112b90 0x7fba6419e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba69de6640 1 -- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba64074eb0 msgr2=0x7fba641a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba69de6640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba64074eb0 0x7fba641a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba69de6640 1 -- 172.21.15.29:0/23295293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba64112b90 msgr2=0x7fba6419e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba69de6640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fba64112b90 0x7fba6419e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba69de6640 1 -- 172.21.15.29:0/23295293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6419efc0 con 0x7fba64074590 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba695e5640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba64074eb0 0x7fba641a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:41.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba69de6640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba641a4680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fba60005cc0 tx=0x7fba6002f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60034040 con 0x7fba64074590 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fba600308f0 con 0x7fba64074590 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6419f250 con 0x7fba64074590 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba600047c0 con 0x7fba64074590 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.550+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba641ab430 con 0x7fba64074590 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.551+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba64062940 con 0x7fba64074590 2024-09-19T07:07:41.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.553+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fba60037020 con 0x7fba64074590 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.553+0000 7fba5affd640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fba500a32d0 0x7fba500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba695e5640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fba500a32d0 0x7fba500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fba600f0eb0 con 0x7fba64074590 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba5affd640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] conn(0x7fba500ae4a0 0x7fba500b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 --> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba500b1010 con 0x7fba500ae4a0 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fba600f1300 con 0x7fba64074590 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba695e5640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fba500a32d0 0x7fba500a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba6419ffa0 tx=0x7fba5400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba6a5e7640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] conn(0x7fba500ae4a0 0x7fba500b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:41.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.554+0000 7fba6a5e7640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] conn(0x7fba500ae4a0 0x7fba500b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.555+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== osd.5 v2:172.21.15.78:6808/2442048151 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba500b1010 con 0x7fba500ae4a0 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.569+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 --> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba64062dc0 con 0x7fba500ae4a0 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.569+0000 7fba5affd640 1 -- 172.21.15.29:0/23295293 <== osd.5 v2:172.21.15.78:6808/2442048151 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fba64062dc0 con 0x7fba500ae4a0 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] conn(0x7fba500ae4a0 msgr2=0x7fba500b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] conn(0x7fba500ae4a0 0x7fba500b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fba500a32d0 msgr2=0x7fba500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fba500a32d0 0x7fba500a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba6419ffa0 tx=0x7fba5400a5c0 comp rx=0 tx=0).stop 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 msgr2=0x7fba641a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 --2- 172.21.15.29:0/23295293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba64074590 0x7fba641a4680 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fba60005cc0 tx=0x7fba6002f650 comp rx=0 tx=0).stop 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6a5e7640 1 -- 172.21.15.29:0/23295293 reap_dead start 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 shutdown_connections 2024-09-19T07:07:41.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 >> 172.21.15.29:0/23295293 conn(0x7fba640fd8c0 msgr2=0x7fba640ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 shutdown_connections 2024-09-19T07:07:41.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.570+0000 7fba6c04a640 1 -- 172.21.15.29:0/23295293 wait complete. 2024-09-19T07:07:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:41 smithi029 ceph-mon[31255]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:41 smithi078 ceph-mon[34556]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:41 smithi046 ceph-mon[34147]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 -- 172.21.15.29:0/2245912145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 msgr2=0x7f979410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 --2- 172.21.15.29:0/2245912145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979410ea90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f978c009ca0 tx=0x7f978c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 -- 172.21.15.29:0/2245912145 shutdown_connections 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 --2- 172.21.15.29:0/2245912145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979410ea90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 --2- 172.21.15.29:0/2245912145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9794102790 0x7f97941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 --2- 172.21.15.29:0/2245912145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9794101de0 0x7f97941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 -- 172.21.15.29:0/2245912145 >> 172.21.15.29:0/2245912145 conn(0x7f97940fd8c0 msgr2=0x7f97940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 -- 172.21.15.29:0/2245912145 shutdown_connections 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.046+0000 7f979aff2640 1 -- 172.21.15.29:0/2245912145 wait complete. 2024-09-19T07:07:42.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 Processor -- start 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 -- start start 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9794101de0 0x7f979419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9794102790 0x7f979419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9794111e70 con 0x7f9794106f10 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9794111cf0 con 0x7f9794101de0 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979aff2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9794111ff0 con 0x7f9794102790 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979958f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979958f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44924/0 (socket says 172.21.15.29:44924) 2024-09-19T07:07:42.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.047+0000 7f979958f640 1 -- 172.21.15.29:0/1407086967 learned_addr learned my addr 172.21.15.29:0/1407086967 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f9793fff640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9794102790 0x7f979419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f9798d8e640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9794101de0 0x7f979419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979958f640 1 -- 172.21.15.29:0/1407086967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9794102790 msgr2=0x7f979419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979958f640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9794102790 0x7f979419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979958f640 1 -- 172.21.15.29:0/1407086967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9794101de0 msgr2=0x7f979419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979958f640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9794101de0 0x7f979419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979958f640 1 -- 172.21.15.29:0/1407086967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979419f520 con 0x7f9794106f10 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f9798d8e640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9794101de0 0x7f979419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979958f640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979419ee40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f978c031040 tx=0x7f978c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c003ce0 con 0x7f9794106f10 2024-09-19T07:07:42.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f978c0044f0 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c030c90 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979419f7b0 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.048+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97941a70f0 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.049+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97940fef20 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.051+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f978c0046a0 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.051+0000 7f9791ffb640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f97840a3350 0x7f97840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9798d8e640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f97840a3350 0x7f97840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f978c0f14e0 con 0x7f9794106f10 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9791ffb640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] conn(0x7f97840ae520 0x7f97840b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:42.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 --> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97840b1090 con 0x7f97840ae520 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f978c0f1890 con 0x7f9794106f10 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9793fff640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] conn(0x7f97840ae520 0x7f97840b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9798d8e640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f97840a3350 0x7f97840a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9788005fd0 tx=0x7f9788005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.052+0000 7f9793fff640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] conn(0x7f97840ae520 0x7f97840b09c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.053+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== osd.0 v2:172.21.15.29:6802/1401604142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97840b1090 con 0x7f97840ae520 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.067+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 --> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97941032c0 con 0x7f97840ae520 2024-09-19T07:07:42.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.067+0000 7f9791ffb640 1 -- 172.21.15.29:0/1407086967 <== osd.0 v2:172.21.15.29:6802/1401604142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f97941032c0 con 0x7f97840ae520 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.067+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] conn(0x7f97840ae520 msgr2=0x7f97840b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.067+0000 7f979aff2640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] conn(0x7f97840ae520 0x7f97840b09c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f97840a3350 msgr2=0x7f97840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f97840a3350 0x7f97840a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9788005fd0 tx=0x7f9788005ea0 comp rx=0 tx=0).stop 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 msgr2=0x7f979419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 --2- 172.21.15.29:0/1407086967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9794106f10 0x7f979419ee40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f978c031040 tx=0x7f978c003970 comp rx=0 tx=0).stop 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979958f640 1 -- 172.21.15.29:0/1407086967 reap_dead start 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 shutdown_connections 2024-09-19T07:07:42.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 >> 172.21.15.29:0/1407086967 conn(0x7f97940fd8c0 msgr2=0x7f97940ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:42.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 shutdown_connections 2024-09-19T07:07:42.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:42.068+0000 7f979aff2640 1 -- 172.21.15.29:0/1407086967 wait complete. 2024-09-19T07:07:43.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 -- 172.21.15.29:0/3111013115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 msgr2=0x7f466c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:43.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 --2- 172.21.15.29:0/3111013115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c100ee0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4658009930 tx=0x7f465802a420 comp rx=0 tx=0).stop 2024-09-19T07:07:43.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 -- 172.21.15.29:0/3111013115 shutdown_connections 2024-09-19T07:07:43.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 --2- 172.21.15.29:0/3111013115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c101420 0x7f466c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 --2- 172.21.15.29:0/3111013115 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c100ee0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 --2- 172.21.15.29:0/3111013115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f466c106a80 0x7f466c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 -- 172.21.15.29:0/3111013115 >> 172.21.15.29:0/3111013115 conn(0x7f466c0fc7a0 msgr2=0x7f466c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 -- 172.21.15.29:0/3111013115 shutdown_connections 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.441+0000 7f4672e6f640 1 -- 172.21.15.29:0/3111013115 wait complete. 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 Processor -- start 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 -- start start 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c101420 0x7f466c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f466c106a80 0x7f466c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:43.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f466c110cf0 con 0x7f466c100a80 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f466c110b70 con 0x7f466c101420 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4672e6f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f466c110e70 con 0x7f466c106a80 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4670c0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4670c0b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44948/0 (socket says 172.21.15.29:44948) 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f4670c0b640 1 -- 172.21.15.29:0/1816197778 learned_addr learned my addr 172.21.15.29:0/1816197778 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.442+0000 7f467140c640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f466c106a80 0x7f466c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f466bfff640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c101420 0x7f466c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4670c0b640 1 -- 172.21.15.29:0/1816197778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f466c106a80 msgr2=0x7f466c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4670c0b640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f466c106a80 0x7f466c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4670c0b640 1 -- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c101420 msgr2=0x7f466c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:43.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4670c0b640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c101420 0x7f466c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4670c0b640 1 -- 172.21.15.29:0/1816197778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c19d310 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f466bfff640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f466c101420 0x7f466c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4670c0b640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c198360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f466000c920 tx=0x7f466000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660007c70 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4660007e10 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660018820 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466c19d600 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.443+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f466c1a4ee0 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.444+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f466c062940 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.445+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f46600189c0 con 0x7f466c100a80 2024-09-19T07:07:43.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.446+0000 7f4669ffb640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32d0 0x7f465c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.446+0000 7f466bfff640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32d0 0x7f465c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.446+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f46600cff00 con 0x7f466c100a80 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.446+0000 7f4669ffb640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] conn(0x7f465c0ae4a0 0x7f465c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.446+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 --> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4660012ec0 con 0x7f465c0ae4a0 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.446+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f46600d25c0 con 0x7f466c100a80 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.447+0000 7f466bfff640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32d0 0x7f465c0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4658000c00 tx=0x7f4658031cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.447+0000 7f467140c640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] conn(0x7f465c0ae4a0 0x7f465c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.447+0000 7f467140c640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] conn(0x7f465c0ae4a0 0x7f465c0b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:43.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.448+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== osd.1 v2:172.21.15.46:6800/4060805731 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4660012ec0 con 0x7f465c0ae4a0 2024-09-19T07:07:43.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.462+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 --> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f466c062dc0 con 0x7f465c0ae4a0 2024-09-19T07:07:43.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.462+0000 7f4669ffb640 1 -- 172.21.15.29:0/1816197778 <== osd.1 v2:172.21.15.46:6800/4060805731 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f466c062dc0 con 0x7f465c0ae4a0 2024-09-19T07:07:43.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] conn(0x7f465c0ae4a0 msgr2=0x7f465c0b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:43.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] conn(0x7f465c0ae4a0 0x7f465c0b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32d0 msgr2=0x7f465c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:43.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32d0 0x7f465c0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4658000c00 tx=0x7f4658031cf0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 msgr2=0x7f466c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:43.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 --2- 172.21.15.29:0/1816197778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f466c100a80 0x7f466c198360 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f466000c920 tx=0x7f466000cde0 comp rx=0 tx=0).stop 2024-09-19T07:07:43.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f467140c640 1 -- 172.21.15.29:0/1816197778 reap_dead start 2024-09-19T07:07:43.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 shutdown_connections 2024-09-19T07:07:43.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 >> 172.21.15.29:0/1816197778 conn(0x7f466c0fc7a0 msgr2=0x7f466c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:43.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 shutdown_connections 2024-09-19T07:07:43.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.463+0000 7f4672e6f640 1 -- 172.21.15.29:0/1816197778 wait complete. 2024-09-19T07:07:43.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:43 smithi029 ceph-mon[31255]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T07:07:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:43 smithi078 ceph-mon[34556]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T07:07:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:43 smithi046 ceph-mon[34147]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T07:07:44.585 INFO:teuthology.orchestra.run.smithi029.stdout:34359738453 2024-09-19T07:07:44.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T07:07:44.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 -- 172.21.15.29:0/345763423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290100e20 msgr2=0x7f4290101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:44.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 --2- 172.21.15.29:0/345763423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290100e20 0x7f4290101200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4280009900 tx=0x7f428002a480 comp rx=0 tx=0).stop 2024-09-19T07:07:44.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 -- 172.21.15.29:0/345763423 shutdown_connections 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 --2- 172.21.15.29:0/345763423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4290102ef0 0x7f429010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 --2- 172.21.15.29:0/345763423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4290102570 0x7f42901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 --2- 172.21.15.29:0/345763423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290100e20 0x7f4290101200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 -- 172.21.15.29:0/345763423 >> 172.21.15.29:0/345763423 conn(0x7f42900fc7d0 msgr2=0x7f42900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 -- 172.21.15.29:0/345763423 shutdown_connections 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 -- 172.21.15.29:0/345763423 wait complete. 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 Processor -- start 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.429+0000 7f42962a0640 1 -- start start 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f42962a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4290100e20 0x7f42901984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f42962a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4290102570 0x7f42901989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f42962a0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290102ef0 0x7f429019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f42962a0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4290110e30 con 0x7f4290102ef0 2024-09-19T07:07:44.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f42962a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4290110cb0 con 0x7f4290102570 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f42962a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4290110fb0 con 0x7f4290100e20 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f429483d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290102ef0 0x7f429019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f428ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4290100e20 0x7f42901984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f428ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4290100e20 0x7f42901984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.29:48372/0 (socket says 172.21.15.29:48372) 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f428ffff640 1 -- 172.21.15.29:0/2277831734 learned_addr learned my addr 172.21.15.29:0/2277831734 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f428f7fe640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4290102570 0x7f42901989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f429483d640 1 -- 172.21.15.29:0/2277831734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4290100e20 msgr2=0x7f42901984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f429483d640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4290100e20 0x7f42901984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f429483d640 1 -- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4290102570 msgr2=0x7f42901989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f429483d640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4290102570 0x7f42901989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.430+0000 7f429483d640 1 -- 172.21.15.29:0/2277831734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429019d450 con 0x7f4290102ef0 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.431+0000 7f429483d640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290102ef0 0x7f429019cd70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f428800e940 tx=0x7f428800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:44.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.431+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288004d20 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.431+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429019d740 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.431+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4288005020 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.431+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42880116d0 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.431+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42901a5020 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.432+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4290106bf0 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.433+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f428800cb20 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428d7fa640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f42780a32d0 0x7f42780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428ffff640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f42780a32d0 0x7f42780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f42880d01e0 con 0x7f4290102ef0 2024-09-19T07:07:44.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428d7fa640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] conn(0x7f42780ae490 0x7f42780b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 --> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4288014ec0 con 0x7f42780ae490 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f42880d0630 con 0x7f4290102ef0 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428ffff640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f42780a32d0 0x7f42780a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f42800096c0 tx=0x7f4280005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.434+0000 7f428f7fe640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] conn(0x7f42780ae490 0x7f42780b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.435+0000 7f428f7fe640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] conn(0x7f42780ae490 0x7f42780b0930 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.436+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== osd.10 v2:172.21.15.46:6824/1753918148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4288014ec0 con 0x7f42780ae490 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.449+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 --> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f42901021b0 con 0x7f42780ae490 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f428d7fa640 1 -- 172.21.15.29:0/2277831734 <== osd.10 v2:172.21.15.46:6824/1753918148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f42901021b0 con 0x7f42780ae490 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] conn(0x7f42780ae490 msgr2=0x7f42780b0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] conn(0x7f42780ae490 0x7f42780b0930 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f42780a32d0 msgr2=0x7f42780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f42780a32d0 0x7f42780a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f42800096c0 tx=0x7f4280005a20 comp rx=0 tx=0).stop 2024-09-19T07:07:44.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290102ef0 msgr2=0x7f429019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:44.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 --2- 172.21.15.29:0/2277831734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4290102ef0 0x7f429019cd70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f428800e940 tx=0x7f428800ee00 comp rx=0 tx=0).stop 2024-09-19T07:07:44.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f429483d640 1 -- 172.21.15.29:0/2277831734 reap_dead start 2024-09-19T07:07:44.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 shutdown_connections 2024-09-19T07:07:44.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.450+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 >> 172.21.15.29:0/2277831734 conn(0x7f42900fc7d0 msgr2=0x7f429006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:44.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.451+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 shutdown_connections 2024-09-19T07:07:44.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:40.451+0000 7f42962a0640 1 -- 172.21.15.29:0/2277831734 wait complete. 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.447+0000 7fa0be315640 1 -- 172.21.15.29:0/2699754311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102ef0 msgr2=0x7fa0b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.447+0000 7fa0be315640 1 --2- 172.21.15.29:0/2699754311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102ef0 0x7fa0b810da40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009ca0 tx=0x7fa0b002a950 comp rx=0 tx=0).stop 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.447+0000 7fa0be315640 1 -- 172.21.15.29:0/2699754311 shutdown_connections 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.447+0000 7fa0be315640 1 --2- 172.21.15.29:0/2699754311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102ef0 0x7fa0b810da40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 --2- 172.21.15.29:0/2699754311 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0b8102570 0x7fa0b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 --2- 172.21.15.29:0/2699754311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b8100e20 0x7fa0b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 -- 172.21.15.29:0/2699754311 >> 172.21.15.29:0/2699754311 conn(0x7fa0b80fc7d0 msgr2=0x7fa0b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 -- 172.21.15.29:0/2699754311 shutdown_connections 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 -- 172.21.15.29:0/2699754311 wait complete. 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 Processor -- start 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.448+0000 7fa0be315640 1 -- start start 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0be315640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b8100e20 0x7fa0b81982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0be315640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102570 0x7fa0b8198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0be315640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0b8102ef0 0x7fa0b819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0be315640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8110e80 con 0x7fa0b8102570 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0be315640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8110d00 con 0x7fa0b8102ef0 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0be315640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8111000 con 0x7fa0b8100e20 2024-09-19T07:07:45.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102570 0x7fa0b8198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102570 0x7fa0b8198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45228/0 (socket says 172.21.15.29:45228) 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 -- 172.21.15.29:0/1452783661 learned_addr learned my addr 172.21.15.29:0/1452783661 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0bc8b2640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0b8102ef0 0x7fa0b819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b7fff640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b8100e20 0x7fa0b81982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 -- 172.21.15.29:0/1452783661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b8100e20 msgr2=0x7fa0b81982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b8100e20 0x7fa0b81982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 -- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0b8102ef0 msgr2=0x7fa0b819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0b8102ef0 0x7fa0b819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 -- 172.21.15.29:0/1452783661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b819d2a0 con 0x7fa0b8102570 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b7fff640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0b8100e20 0x7fa0b81982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b77fe640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102570 0x7fa0b8198830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c920 tx=0x7fa0ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.449+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac007c70 con 0x7fa0b8102570 2024-09-19T07:07:45.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.450+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0ac007e10 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.450+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b819d590 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.450+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac018820 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.450+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b81a4e70 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.450+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0b8062940 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.452+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa0ac0189c0 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.452+0000 7fa0b57fa640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa0a00a3350 0x7fa0a00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0b7fff640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa0a00a3350 0x7fa0a00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fa0ac0d0400 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0b57fa640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] conn(0x7fa0a00ae520 0x7fa0a00b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 --> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0ac015e70 con 0x7fa0a00ae520 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa0ac0d0850 con 0x7fa0b8102570 2024-09-19T07:07:45.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0b7fff640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa0a00a3350 0x7fa0a00a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8005fd0 tx=0x7fa0a8005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.453+0000 7fa0bc8b2640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] conn(0x7fa0a00ae520 0x7fa0a00b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.454+0000 7fa0bc8b2640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] conn(0x7fa0a00ae520 0x7fa0a00b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.455+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== osd.4 v2:172.21.15.46:6808/4193654179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa0ac015e70 con 0x7fa0a00ae520 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.468+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 --> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0b8062d40 con 0x7fa0a00ae520 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0b57fa640 1 -- 172.21.15.29:0/1452783661 <== osd.4 v2:172.21.15.46:6808/4193654179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa0b8062d40 con 0x7fa0a00ae520 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] conn(0x7fa0a00ae520 msgr2=0x7fa0a00b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:45.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0be315640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] conn(0x7fa0a00ae520 0x7fa0a00b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa0a00a3350 msgr2=0x7fa0a00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0be315640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa0a00a3350 0x7fa0a00a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8005fd0 tx=0x7fa0a8005ea0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102570 msgr2=0x7fa0b8198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0be315640 1 --2- 172.21.15.29:0/1452783661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa0b8102570 0x7fa0b8198830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00c920 tx=0x7fa0ac00cde0 comp rx=0 tx=0).stop 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.469+0000 7fa0bc8b2640 1 -- 172.21.15.29:0/1452783661 reap_dead start 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.470+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 shutdown_connections 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.470+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 >> 172.21.15.29:0/1452783661 conn(0x7fa0b80fc7d0 msgr2=0x7fa0b806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.470+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 shutdown_connections 2024-09-19T07:07:45.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:45.470+0000 7fa0be315640 1 -- 172.21.15.29:0/1452783661 wait complete. 2024-09-19T07:07:45.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:45 smithi029 ceph-mon[31255]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:45 smithi078 ceph-mon[34556]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:45 smithi046 ceph-mon[34147]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 -- 172.21.15.29:0/692150857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c101420 msgr2=0x7fd02c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 --2- 172.21.15.29:0/692150857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c101420 0x7fd02c10d950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd024009c10 tx=0x7fd02402a6e0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 -- 172.21.15.29:0/692150857 shutdown_connections 2024-09-19T07:07:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 --2- 172.21.15.29:0/692150857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c101420 0x7fd02c10d950 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 --2- 172.21.15.29:0/692150857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd02c100a80 0x7fd02c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 --2- 172.21.15.29:0/692150857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c106a80 0x7fd02c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 -- 172.21.15.29:0/692150857 >> 172.21.15.29:0/692150857 conn(0x7fd02c0fc7a0 msgr2=0x7fd02c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 -- 172.21.15.29:0/692150857 shutdown_connections 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.017+0000 7fd031a53640 1 -- 172.21.15.29:0/692150857 wait complete. 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 Processor -- start 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 -- start start 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c100a80 0x7fd02c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd02c101420 0x7fd02c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c106a80 0x7fd02c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c111e30 con 0x7fd02c100a80 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c111cb0 con 0x7fd02c101420 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.018+0000 7fd031a53640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd02c111fb0 con 0x7fd02c106a80 2024-09-19T07:07:46.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c100a80 0x7fd02c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c100a80 0x7fd02c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45246/0 (socket says 172.21.15.29:45246) 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 -- 172.21.15.29:0/1048367555 learned_addr learned my addr 172.21.15.29:0/1048367555 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02b7fe640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c106a80 0x7fd02c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02a7fc640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd02c101420 0x7fd02c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 -- 172.21.15.29:0/1048367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c106a80 msgr2=0x7fd02c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c106a80 0x7fd02c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 -- 172.21.15.29:0/1048367555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd02c101420 msgr2=0x7fd02c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd02c101420 0x7fd02c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 -- 172.21.15.29:0/1048367555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02c19d340 con 0x7fd02c100a80 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02b7fe640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd02c106a80 0x7fd02c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd02affd640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c100a80 0x7fd02c198390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00e9f0 tx=0x7fd01c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00ccc0 con 0x7fd02c100a80 2024-09-19T07:07:46.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd01c0054d0 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02c19d630 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c010430 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.019+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02c1a4f10 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.020+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd02c062980 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.022+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd01c0046c0 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.022+0000 7fd030a51640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd0140a32d0 0x7fd0140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.022+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fd01c0d0570 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.022+0000 7fd02a7fc640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd0140a32d0 0x7fd0140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.023+0000 7fd030a51640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] conn(0x7fd0140ae4a0 0x7fd0140b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.023+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 --> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0140b1010 con 0x7fd0140ae4a0 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.023+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd01c0d09c0 con 0x7fd02c100a80 2024-09-19T07:07:46.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.023+0000 7fd02b7fe640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] conn(0x7fd0140ae4a0 0x7fd0140b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.023+0000 7fd02a7fc640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd0140a32d0 0x7fd0140a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd020005fd0 tx=0x7fd020005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.023+0000 7fd02b7fe640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] conn(0x7fd0140ae4a0 0x7fd0140b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.024+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== osd.9 v2:172.21.15.29:6826/3365910689 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0140b1010 con 0x7fd0140ae4a0 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.037+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 --> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd02c062e00 con 0x7fd0140ae4a0 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd030a51640 1 -- 172.21.15.29:0/1048367555 <== osd.9 v2:172.21.15.29:6826/3365910689 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd02c062e00 con 0x7fd0140ae4a0 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] conn(0x7fd0140ae4a0 msgr2=0x7fd0140b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] conn(0x7fd0140ae4a0 0x7fd0140b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd0140a32d0 msgr2=0x7fd0140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fd0140a32d0 0x7fd0140a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd020005fd0 tx=0x7fd020005850 comp rx=0 tx=0).stop 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c100a80 msgr2=0x7fd02c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 --2- 172.21.15.29:0/1048367555 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd02c100a80 0x7fd02c198390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00e9f0 tx=0x7fd01c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd02b7fe640 1 -- 172.21.15.29:0/1048367555 reap_dead start 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 shutdown_connections 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 >> 172.21.15.29:0/1048367555 conn(0x7fd02c0fc7a0 msgr2=0x7fd02c0fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 shutdown_connections 2024-09-19T07:07:46.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:46.038+0000 7fd031a53640 1 -- 172.21.15.29:0/1048367555 wait complete. 2024-09-19T07:07:46.538 INFO:teuthology.orchestra.run.smithi029.stdout:137438953539 2024-09-19T07:07:46.538 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T07:07:46.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.658+0000 7f605fb62640 1 -- 172.21.15.29:0/1125995878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 msgr2=0x7f6058100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.658+0000 7f605fb62640 1 --2- 172.21.15.29:0/1125995878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f6058100cb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6054009900 tx=0x7f605402a410 comp rx=0 tx=0).stop 2024-09-19T07:07:46.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 -- 172.21.15.29:0/1125995878 shutdown_connections 2024-09-19T07:07:46.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 --2- 172.21.15.29:0/1125995878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f605810e480 0x7f6058110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 --2- 172.21.15.29:0/1125995878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6058101280 0x7f605810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 --2- 172.21.15.29:0/1125995878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f6058100cb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 -- 172.21.15.29:0/1125995878 >> 172.21.15.29:0/1125995878 conn(0x7f60580fc7a0 msgr2=0x7f60580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 -- 172.21.15.29:0/1125995878 shutdown_connections 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 -- 172.21.15.29:0/1125995878 wait complete. 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 Processor -- start 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 -- start start 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f605819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6058101280 0x7f605819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.659+0000 7f605fb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f605810e480 0x7f605819edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605fb62640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6058114040 con 0x7f60581008d0 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605fb62640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6058113ec0 con 0x7f6058101280 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605fb62640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f60581141c0 con 0x7f605810e480 2024-09-19T07:07:46.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f605819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f605819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:44964/0 (socket says 172.21.15.29:44964) 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 -- 172.21.15.29:0/1305658933 learned_addr learned my addr 172.21.15.29:0/1305658933 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d0fd640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6058101280 0x7f605819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605e0ff640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f605810e480 0x7f605819edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 -- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f605810e480 msgr2=0x7f605819edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f605810e480 0x7f605819edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 -- 172.21.15.29:0/1305658933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6058101280 msgr2=0x7f605819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6058101280 0x7f605819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 -- 172.21.15.29:0/1305658933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605819f4d0 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605d8fe640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f605819a520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6054005940 tx=0x7f6054004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605403f030 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6054003aa0 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605819f760 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054035070 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.660+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60581a70a0 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.661+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6058062980 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.663+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6054042030 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.663+0000 7f604effd640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60440a3350 0x7f60440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.663+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f60540f0c80 con 0x7f60581008d0 2024-09-19T07:07:46.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.663+0000 7f605d0fd640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60440a3350 0x7f60440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.663+0000 7f604effd640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] conn(0x7f60440ae520 0x7f60440b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.664+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 --> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60440b1090 con 0x7f60440ae520 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.664+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f60540f10d0 con 0x7f60581008d0 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.664+0000 7f605d0fd640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60440a3350 0x7f60440a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6048005e10 tx=0x7f6048005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.664+0000 7f605e0ff640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] conn(0x7f60440ae520 0x7f60440b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.664+0000 7f605e0ff640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] conn(0x7f60440ae520 0x7f60440b09c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.665+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== osd.11 v2:172.21.15.78:6824/442617082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60440b1090 con 0x7f60440ae520 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 --> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6058062d80 con 0x7f60440ae520 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f604effd640 1 -- 172.21.15.29:0/1305658933 <== osd.11 v2:172.21.15.78:6824/442617082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6058062d80 con 0x7f60440ae520 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] conn(0x7f60440ae520 msgr2=0x7f60440b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] conn(0x7f60440ae520 0x7f60440b09c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60440a3350 msgr2=0x7f60440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f60440a3350 0x7f60440a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6048005e10 tx=0x7f6048005da0 comp rx=0 tx=0).stop 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 msgr2=0x7f605819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605fb62640 1 --2- 172.21.15.29:0/1305658933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60581008d0 0x7f605819a520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6054005940 tx=0x7f6054004270 comp rx=0 tx=0).stop 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.679+0000 7f605e0ff640 1 -- 172.21.15.29:0/1305658933 reap_dead start 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.680+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 shutdown_connections 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.680+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 >> 172.21.15.29:0/1305658933 conn(0x7f60580fc7a0 msgr2=0x7f60580feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.680+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 shutdown_connections 2024-09-19T07:07:46.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:43.680+0000 7f605fb62640 1 -- 172.21.15.29:0/1305658933 wait complete. 2024-09-19T07:07:47.295 INFO:teuthology.orchestra.run.smithi029.stdout:326417514526 2024-09-19T07:07:47.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T07:07:47.775 INFO:teuthology.orchestra.run.smithi029.stdout:103079215175 2024-09-19T07:07:47.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T07:07:47.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:47 smithi029 ceph-mon[31255]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:47.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:47 smithi078 ceph-mon[34556]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:47 smithi046 ceph-mon[34147]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:48.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 -- 172.21.15.29:0/907250888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270102d40 msgr2=0x7ff270103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:48.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 --2- 172.21.15.29:0/907250888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270102d40 0x7ff270103120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff260009900 tx=0x7ff26002a480 comp rx=0 tx=0).stop 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 -- 172.21.15.29:0/907250888 shutdown_connections 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 --2- 172.21.15.29:0/907250888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff27010c170 0x7ff27010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 --2- 172.21.15.29:0/907250888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff270103660 0x7ff27010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 --2- 172.21.15.29:0/907250888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270102d40 0x7ff270103120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 -- 172.21.15.29:0/907250888 >> 172.21.15.29:0/907250888 conn(0x7ff2700fc7a0 msgr2=0x7ff2700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 -- 172.21.15.29:0/907250888 shutdown_connections 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.300+0000 7ff27590f640 1 -- 172.21.15.29:0/907250888 wait complete. 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 Processor -- start 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 -- start start 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff270102d40 0x7ff270198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270103660 0x7ff2701988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:48.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27010c170 0x7ff27019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff270111e20 con 0x7ff270103660 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff270111ca0 con 0x7ff27010c170 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff27590f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff270111fa0 con 0x7ff270102d40 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.301+0000 7ff26e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270103660 0x7ff2701988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270103660 0x7ff2701988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45262/0 (socket says 172.21.15.29:45262) 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 -- 172.21.15.29:0/3781597147 learned_addr learned my addr 172.21.15.29:0/3781597147 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27010c170 0x7ff27019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26effd640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff270102d40 0x7ff270198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 -- 172.21.15.29:0/3781597147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff270102d40 msgr2=0x7ff270198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff270102d40 0x7ff270198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 -- 172.21.15.29:0/3781597147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27010c170 msgr2=0x7ff27019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27010c170 0x7ff27019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 -- 172.21.15.29:0/3781597147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27019d320 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff26e7fc640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270103660 0x7ff2701988b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d950 tx=0x7ff26400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff264017030 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff264004020 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27019d610 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2640055e0 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.302+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701a4ef0 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.303+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff270062940 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.304+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff2640041d0 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff27490d640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2580a32d0 0x7ff2580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff26effd640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2580a32d0 0x7ff2580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7ff2640cfe30 con 0x7ff270103660 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff27490d640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] conn(0x7ff2580ae4a0 0x7ff2580b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:48.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 --> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff264024ea0 con 0x7ff2580ae4a0 2024-09-19T07:07:48.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7ff2640d01e0 con 0x7ff270103660 2024-09-19T07:07:48.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.305+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] conn(0x7ff2580ae4a0 0x7ff2580b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:48.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.306+0000 7ff26effd640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2580a32d0 0x7ff2580a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff260000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:48.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.306+0000 7ff26f7fe640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] conn(0x7ff2580ae4a0 0x7ff2580b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:48.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.307+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== osd.6 v2:172.21.15.29:6818/4093011599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff264024ea0 con 0x7ff2580ae4a0 2024-09-19T07:07:48.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.320+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 --> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff270062d40 con 0x7ff2580ae4a0 2024-09-19T07:07:48.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27490d640 1 -- 172.21.15.29:0/3781597147 <== osd.6 v2:172.21.15.29:6818/4093011599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff270062d40 con 0x7ff2580ae4a0 2024-09-19T07:07:48.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] conn(0x7ff2580ae4a0 msgr2=0x7ff2580b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:48.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] conn(0x7ff2580ae4a0 0x7ff2580b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2580a32d0 msgr2=0x7ff2580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff2580a32d0 0x7ff2580a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff260006010 tx=0x7ff260000bc0 comp rx=0 tx=0).stop 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270103660 msgr2=0x7ff2701988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 --2- 172.21.15.29:0/3781597147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff270103660 0x7ff2701988b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff26400d950 tx=0x7ff26400de10 comp rx=0 tx=0).stop 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff26f7fe640 1 -- 172.21.15.29:0/3781597147 reap_dead start 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 shutdown_connections 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 >> 172.21.15.29:0/3781597147 conn(0x7ff2700fc7a0 msgr2=0x7ff2700fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 shutdown_connections 2024-09-19T07:07:48.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:48.321+0000 7ff27590f640 1 -- 172.21.15.29:0/3781597147 wait complete. 2024-09-19T07:07:48.780 INFO:teuthology.orchestra.run.smithi029.stdout:158913790013 2024-09-19T07:07:48.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T07:07:49.791 INFO:teuthology.orchestra.run.smithi029.stdout:55834574930 2024-09-19T07:07:49.791 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T07:07:49.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:49 smithi029 ceph-mon[31255]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:49 smithi078 ceph-mon[34556]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:49 smithi046 ceph-mon[34147]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:50.342 INFO:teuthology.orchestra.run.smithi029.stdout:274877906982 2024-09-19T07:07:50.342 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T07:07:50.781 INFO:teuthology.orchestra.run.smithi029.stdout:210453397553 2024-09-19T07:07:50.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T07:07:51.453 INFO:teuthology.orchestra.run.smithi029.stdout:188978561079 2024-09-19T07:07:51.453 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T07:07:51.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 -- 172.21.15.29:0/843879321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102ef0 msgr2=0x7f29b010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 --2- 172.21.15.29:0/843879321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102ef0 0x7f29b010da40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009ca0 tx=0x7f29a802a950 comp rx=0 tx=0).stop 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 -- 172.21.15.29:0/843879321 shutdown_connections 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 --2- 172.21.15.29:0/843879321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102ef0 0x7f29b010da40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 --2- 172.21.15.29:0/843879321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b0102570 0x7f29b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 --2- 172.21.15.29:0/843879321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b0100e20 0x7f29b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 -- 172.21.15.29:0/843879321 >> 172.21.15.29:0/843879321 conn(0x7f29b00fc7d0 msgr2=0x7f29b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 -- 172.21.15.29:0/843879321 shutdown_connections 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 -- 172.21.15.29:0/843879321 wait complete. 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 Processor -- start 2024-09-19T07:07:51.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.283+0000 7f29b68e8640 1 -- start start 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b68e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b0100e20 0x7f29b019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b68e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102570 0x7f29b019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b68e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b0102ef0 0x7f29b019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b68e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0110e30 con 0x7f29b0102570 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b68e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0110cb0 con 0x7f29b0100e20 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b68e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0110fb0 con 0x7f29b0102ef0 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102570 0x7f29b019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102570 0x7f29b019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45286/0 (socket says 172.21.15.29:45286) 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 -- 172.21.15.29:0/3563655404 learned_addr learned my addr 172.21.15.29:0/3563655404 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b4e85640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b0102ef0 0x7f29b019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:51.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29affff640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b0100e20 0x7f29b019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 -- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b0102ef0 msgr2=0x7f29b019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b0102ef0 0x7f29b019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 -- 172.21.15.29:0/3563655404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b0100e20 msgr2=0x7f29b019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29b0100e20 0x7f29b019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 -- 172.21.15.29:0/3563655404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b019f3f0 con 0x7f29b0102570 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29b4e85640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29b0102ef0 0x7f29b019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.284+0000 7f29af7fe640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102570 0x7f29b019a980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c920 tx=0x7f29a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.285+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4007c70 con 0x7f29b0102570 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.285+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29a4007e10 con 0x7f29b0102570 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.285+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b019f6e0 con 0x7f29b0102570 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.285+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4018820 con 0x7f29b0102570 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.285+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a6fc0 con 0x7f29b0102570 2024-09-19T07:07:51.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.285+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29b010d0f0 con 0x7f29b0102570 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.287+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f29a40189c0 con 0x7f29b0102570 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.287+0000 7f29ad7fa640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29980a3350 0x7f29980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29affff640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29980a3350 0x7f29980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f29a40d0400 con 0x7f29b0102570 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29ad7fa640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] conn(0x7f29980ae520 0x7f29980b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 --> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29a4015e70 con 0x7f29980ae520 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f29a40d0850 con 0x7f29b0102570 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29b4e85640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] conn(0x7f29980ae520 0x7f29980b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:51.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29affff640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29980a3350 0x7f29980a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f29a0005e10 tx=0x7f29a0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.288+0000 7f29b4e85640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] conn(0x7f29980ae520 0x7f29980b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.289+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== osd.8 v2:172.21.15.78:6816/738881945 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29a4015e70 con 0x7f29980ae520 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.304+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 --> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29b01021b0 con 0x7f29980ae520 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.304+0000 7f29ad7fa640 1 -- 172.21.15.29:0/3563655404 <== osd.8 v2:172.21.15.78:6816/738881945 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29b01021b0 con 0x7f29980ae520 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.304+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] conn(0x7f29980ae520 msgr2=0x7f29980b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] conn(0x7f29980ae520 0x7f29980b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29980a3350 msgr2=0x7f29980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:51.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29980a3350 0x7f29980a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f29a0005e10 tx=0x7f29a0005da0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102570 msgr2=0x7f29b019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 --2- 172.21.15.29:0/3563655404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29b0102570 0x7f29b019a980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c920 tx=0x7f29a400cde0 comp rx=0 tx=0).stop 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b4e85640 1 -- 172.21.15.29:0/3563655404 reap_dead start 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 shutdown_connections 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 >> 172.21.15.29:0/3563655404 conn(0x7f29b00fc7d0 msgr2=0x7f29b006a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 shutdown_connections 2024-09-19T07:07:51.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:49.305+0000 7f29b68e8640 1 -- 172.21.15.29:0/3563655404 wait complete. 2024-09-19T07:07:51.866 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:51 smithi029 ceph-mon[31255]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:51.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:51 smithi078 ceph-mon[34556]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:51 smithi046 ceph-mon[34147]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:52.201 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:52.232 INFO:teuthology.orchestra.run.smithi029.stdout:240518168623 2024-09-19T07:07:52.232 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T07:07:52.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 -- 172.21.15.29:0/1281203114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4100e20 msgr2=0x7f2fa4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:52.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 --2- 172.21.15.29:0/1281203114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4100e20 0x7f2fa4101200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009900 tx=0x7f2f9402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:52.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 -- 172.21.15.29:0/1281203114 shutdown_connections 2024-09-19T07:07:52.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 --2- 172.21.15.29:0/1281203114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4102ef0 0x7f2fa410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 --2- 172.21.15.29:0/1281203114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102570 0x7f2fa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 --2- 172.21.15.29:0/1281203114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4100e20 0x7f2fa4101200 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 -- 172.21.15.29:0/1281203114 >> 172.21.15.29:0/1281203114 conn(0x7f2fa40fc7d0 msgr2=0x7f2fa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 -- 172.21.15.29:0/1281203114 shutdown_connections 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.785+0000 7f2fa9055640 1 -- 172.21.15.29:0/1281203114 wait complete. 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.786+0000 7f2fa9055640 1 Processor -- start 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 -- start start 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 0x7f2fa4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4102570 0x7f2fa41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102ef0 0x7f2fa419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:52.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4110e80 con 0x7f2fa4102570 2024-09-19T07:07:52.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4110d00 con 0x7f2fa4100e20 2024-09-19T07:07:52.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa9055640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4111000 con 0x7f2fa4102ef0 2024-09-19T07:07:52.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 0x7f2fa4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:52.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 0x7f2fa4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.29:54358/0 (socket says 172.21.15.29:54358) 2024-09-19T07:07:52.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa2d9d640 1 -- 172.21.15.29:0/419181649 learned_addr learned my addr 172.21.15.29:0/419181649 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:52.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa359e640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102ef0 0x7f2fa419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:52.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.787+0000 7f2fa259c640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4102570 0x7f2fa41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:52.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa2d9d640 1 -- 172.21.15.29:0/419181649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102ef0 msgr2=0x7f2fa419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa2d9d640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102ef0 0x7f2fa419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa2d9d640 1 -- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4102570 msgr2=0x7f2fa41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa2d9d640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4102570 0x7f2fa41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa2d9d640 1 -- 172.21.15.29:0/419181649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa419d410 con 0x7f2fa4100e20 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa359e640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102ef0 0x7f2fa419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa259c640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4102570 0x7f2fa41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa2d9d640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 0x7f2fa4198460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f9402aa70 tx=0x7f2f94003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9403f070 con 0x7f2fa4100e20 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa419d6a0 con 0x7f2fa4100e20 2024-09-19T07:07:52.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2f9403bb20 con 0x7f2fa4100e20 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94035030 con 0x7f2fa4100e20 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.788+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa41a4fe0 con 0x7f2fa4100e20 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.789+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa41021b0 con 0x7f2fa4100e20 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.791+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2f94042070 con 0x7f2fa4100e20 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.791+0000 7f2f8bfff640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2f8c0a32d0 0x7f2f8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.792+0000 7f2fa259c640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2f8c0a32d0 0x7f2f8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.792+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f2f940f0550 con 0x7f2fa4100e20 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.792+0000 7f2fa259c640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2f8c0a32d0 0x7f2f8c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40fffa0 tx=0x7f2f98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:52.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.795+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f940bc740 con 0x7f2fa4100e20 2024-09-19T07:07:52.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.975+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2fa41a51b0 con 0x7f2fa4100e20 2024-09-19T07:07:52.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.976+0000 7f2f8bfff640 1 -- 172.21.15.29:0/419181649 <== mon.2 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f940c0a40 con 0x7f2fa4100e20 2024-09-19T07:07:52.977 INFO:teuthology.orchestra.run.smithi029.stdout:77309411407 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2f8c0a32d0 msgr2=0x7f2f8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2f8c0a32d0 0x7f2f8c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40fffa0 tx=0x7f2f98005f90 comp rx=0 tx=0).stop 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 msgr2=0x7f2fa4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 0x7f2fa4198460 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f9402aa70 tx=0x7f2f94003c10 comp rx=0 tx=0).stop 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 shutdown_connections 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2f8c0a32d0 0x7f2f8c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fa4102ef0 0x7f2fa419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fa4102570 0x7f2fa41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 --2- 172.21.15.29:0/419181649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fa4100e20 0x7f2fa4198460 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:52.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 >> 172.21.15.29:0/419181649 conn(0x7f2fa40fc7d0 msgr2=0x7f2fa406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:52.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 shutdown_connections 2024-09-19T07:07:52.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:52.978+0000 7f2fa9055640 1 -- 172.21.15.29:0/419181649 wait complete. 2024-09-19T07:07:53.499 INFO:teuthology.orchestra.run.smithi029.stdout:296352743457 2024-09-19T07:07:53.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T07:07:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:53.522 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:53.829 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:53 smithi029 ceph-mon[31255]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:53.829 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:53 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/419181649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:07:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:53 smithi078 ceph-mon[34556]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:53 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/419181649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:07:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:53 smithi046 ceph-mon[34147]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:53 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/419181649' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 -- 172.21.15.29:0/1152677814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64106f10 msgr2=0x7fbc6410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/1152677814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64106f10 0x7fbc6410ea90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009ca0 tx=0x7fbc5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 -- 172.21.15.29:0/1152677814 shutdown_connections 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/1152677814 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64106f10 0x7fbc6410ea90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/1152677814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc64102790 0x7fbc641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/1152677814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc64101de0 0x7fbc641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 -- 172.21.15.29:0/1152677814 >> 172.21.15.29:0/1152677814 conn(0x7fbc640fd8c0 msgr2=0x7fbc640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 -- 172.21.15.29:0/1152677814 shutdown_connections 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.244+0000 7fbc6bf46640 1 -- 172.21.15.29:0/1152677814 wait complete. 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 Processor -- start 2024-09-19T07:07:54.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 -- start start 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 0x7fbc640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc64102790 0x7fbc64074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc64106f10 0x7fbc64074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64111e40 con 0x7fbc64101de0 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64111cc0 con 0x7fbc64102790 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6bf46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc64111fc0 con 0x7fbc64106f10 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 0x7fbc640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 0x7fbc640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:45310/0 (socket says 172.21.15.29:45310) 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 -- 172.21.15.29:0/2698334630 learned_addr learned my addr 172.21.15.29:0/2698334630 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc694e1640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc64102790 0x7fbc64074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc6a4e3640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc64106f10 0x7fbc64074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 -- 172.21.15.29:0/2698334630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc64106f10 msgr2=0x7fbc64074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:54.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc64106f10 0x7fbc64074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 -- 172.21.15.29:0/2698334630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc64102790 msgr2=0x7fbc64074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc64102790 0x7fbc64074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.245+0000 7fbc69ce2640 1 -- 172.21.15.29:0/2698334630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc641a68a0 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.246+0000 7fbc69ce2640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 0x7fbc640744f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000e9f0 tx=0x7fbc6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.246+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000cd80 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.246+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc641a6b90 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.246+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbc600108e0 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.246+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc60018920 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.246+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc641a70d0 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.247+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc641021c0 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.248+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbc60010a90 con 0x7fbc64101de0 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.249+0000 7fbc5affd640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbc500a32d0 0x7fbc500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:54.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.249+0000 7fbc694e1640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbc500a32d0 0x7fbc500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:54.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.249+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fbc600d07c0 con 0x7fbc64101de0 2024-09-19T07:07:54.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.249+0000 7fbc694e1640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbc500a32d0 0x7fbc500a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbc64075f80 tx=0x7fbc54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:54.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.252+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc6009cfc0 con 0x7fbc64101de0 2024-09-19T07:07:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:54.362 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:54.364 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:54.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.462+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fbc64075a20 con 0x7fbc64101de0 2024-09-19T07:07:54.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.462+0000 7fbc5affd640 1 -- 172.21.15.29:0/2698334630 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fbc64075a20 con 0x7fbc64101de0 2024-09-19T07:07:54.463 INFO:teuthology.orchestra.run.smithi029.stdout:326417514527 2024-09-19T07:07:54.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbc500a32d0 msgr2=0x7fbc500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:54.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbc500a32d0 0x7fbc500a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbc64075f80 tx=0x7fbc54008040 comp rx=0 tx=0).stop 2024-09-19T07:07:54.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 msgr2=0x7fbc640744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:54.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 0x7fbc640744f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000e9f0 tx=0x7fbc6000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 shutdown_connections 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fbc500a32d0 0x7fbc500a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc64106f10 0x7fbc64074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbc64102790 0x7fbc64074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 --2- 172.21.15.29:0/2698334630 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc64101de0 0x7fbc640744f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 >> 172.21.15.29:0/2698334630 conn(0x7fbc640fd8c0 msgr2=0x7fbc640fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.464+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 shutdown_connections 2024-09-19T07:07:54.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:54.465+0000 7fbc6bf46640 1 -- 172.21.15.29:0/2698334630 wait complete. 2024-09-19T07:07:54.833 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:54 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2698334630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:07:54.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411404 got 77309411407 for osd.2 2024-09-19T07:07:54.872 DEBUG:teuthology.parallel:result is None 2024-09-19T07:07:54.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:54 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2698334630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:07:54.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:54 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2698334630' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:07:55.686 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:55 smithi029 ceph-mon[31255]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T07:07:55.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:55 smithi078 ceph-mon[34556]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T07:07:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:55 smithi046 ceph-mon[34147]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-19T07:07:56.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 -- 172.21.15.29:0/548205593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8106f20 msgr2=0x7f78e810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 --2- 172.21.15.29:0/548205593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8106f20 0x7f78e810eaa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009ca0 tx=0x7f78e002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 -- 172.21.15.29:0/548205593 shutdown_connections 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 --2- 172.21.15.29:0/548205593 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8106f20 0x7f78e810eaa0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 --2- 172.21.15.29:0/548205593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 0x7f78e81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 --2- 172.21.15.29:0/548205593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8101df0 0x7f78e81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.473+0000 7f78ef490640 1 -- 172.21.15.29:0/548205593 >> 172.21.15.29:0/548205593 conn(0x7f78e80fd8f0 msgr2=0x7f78e80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.474+0000 7f78ef490640 1 -- 172.21.15.29:0/548205593 shutdown_connections 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.474+0000 7f78ef490640 1 -- 172.21.15.29:0/548205593 wait complete. 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 Processor -- start 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 -- start start 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 0x7f78e81983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 0x7f78e8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8106f20 0x7f78e819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8111e80 con 0x7f78e8101df0 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8111d00 con 0x7f78e8106f20 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ef490640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8112000 con 0x7f78e81027a0 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ed22c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 0x7f78e81983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ed22c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 0x7f78e81983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46216/0 (socket says 172.21.15.29:46216) 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.475+0000 7f78ed22c640 1 -- 172.21.15.29:0/4235436756 learned_addr learned my addr 172.21.15.29:0/4235436756 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78eca2b640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 0x7f78e8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78eda2d640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8106f20 0x7f78e819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ed22c640 1 -- 172.21.15.29:0/4235436756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 msgr2=0x7f78e8198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ed22c640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 0x7f78e8198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ed22c640 1 -- 172.21.15.29:0/4235436756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8106f20 msgr2=0x7f78e819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ed22c640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8106f20 0x7f78e819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ed22c640 1 -- 172.21.15.29:0/4235436756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e819d370 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78eca2b640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 0x7f78e8198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78eda2d640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8106f20 0x7f78e819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ed22c640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 0x7f78e81983c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f78e400e9f0 tx=0x7f78e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e400cd80 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e819d660 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f78e40108e0 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e4018920 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.476+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e81a4f40 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.478+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e81021d0 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.479+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f78e4010a90 con 0x7f78e8101df0 2024-09-19T07:07:56.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.480+0000 7f78de7fc640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f78d40a32d0 0x7f78d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.480+0000 7f78eca2b640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f78d40a32d0 0x7f78d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.480+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f78e40d0760 con 0x7f78e8101df0 2024-09-19T07:07:56.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.481+0000 7f78eca2b640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f78d40a32d0 0x7f78d40a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f78e8108790 tx=0x7f78d80094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:56.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.484+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78e409cfc0 con 0x7f78e8101df0 2024-09-19T07:07:56.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.696+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f78e810a160 con 0x7f78e8101df0 2024-09-19T07:07:56.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.697+0000 7f78de7fc640 1 -- 172.21.15.29:0/4235436756 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f78e409c8c0 con 0x7f78e8101df0 2024-09-19T07:07:56.698 INFO:teuthology.orchestra.run.smithi029.stdout:188978561081 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f78d40a32d0 msgr2=0x7f78d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f78d40a32d0 0x7f78d40a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f78e8108790 tx=0x7f78d80094b0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 msgr2=0x7f78e81983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 0x7f78e81983c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f78e400e9f0 tx=0x7f78e400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 shutdown_connections 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78e8106f20 0x7f78e819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f78d40a32d0 0x7f78d40a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78e81027a0 0x7f78e8198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 --2- 172.21.15.29:0/4235436756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78e8101df0 0x7f78e81983c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 >> 172.21.15.29:0/4235436756 conn(0x7f78e80fd8f0 msgr2=0x7f78e80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:56.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 shutdown_connections 2024-09-19T07:07:56.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.699+0000 7f78ef490640 1 -- 172.21.15.29:0/4235436756 wait complete. 2024-09-19T07:07:56.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 -- 172.21.15.29:0/2564439053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854100e20 msgr2=0x7fa854101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 --2- 172.21.15.29:0/2564439053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854100e20 0x7fa854101200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa844009900 tx=0x7fa84402a480 comp rx=0 tx=0).stop 2024-09-19T07:07:56.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 -- 172.21.15.29:0/2564439053 shutdown_connections 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 --2- 172.21.15.29:0/2564439053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa854102ef0 0x7fa85410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 --2- 172.21.15.29:0/2564439053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854102570 0x7fa8541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 --2- 172.21.15.29:0/2564439053 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854100e20 0x7fa854101200 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 -- 172.21.15.29:0/2564439053 >> 172.21.15.29:0/2564439053 conn(0x7fa8540fc7d0 msgr2=0x7fa8540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 -- 172.21.15.29:0/2564439053 shutdown_connections 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 -- 172.21.15.29:0/2564439053 wait complete. 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 Processor -- start 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.714+0000 7fa85a920640 1 -- start start 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa85a920640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 0x7fa8541992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa85a920640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa854102570 0x7fa854199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa85a920640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 0x7fa8541a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa85a920640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa854110e30 con 0x7fa854102ef0 2024-09-19T07:07:56.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa85a920640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa854110cb0 con 0x7fa854100e20 2024-09-19T07:07:56.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa85a920640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa854110fb0 con 0x7fa854102570 2024-09-19T07:07:56.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa853fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 0x7fa8541992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 0x7fa8541a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 0x7fa8541a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46238/0 (socket says 172.21.15.29:46238) 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa853fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 0x7fa8541992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.29:54426/0 (socket says 172.21.15.29:54426) 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 -- 172.21.15.29:0/1245395240 learned_addr learned my addr 172.21.15.29:0/1245395240 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa84bfff640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa854102570 0x7fa854199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 -- 172.21.15.29:0/1245395240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa854102570 msgr2=0x7fa854199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa854102570 0x7fa854199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 -- 172.21.15.29:0/1245395240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 msgr2=0x7fa8541992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 0x7fa8541992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 -- 172.21.15.29:0/1245395240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8541a4880 con 0x7fa854102ef0 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa853fff640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 0x7fa8541992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:07:56.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.715+0000 7fa858ebd640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 0x7fa8541a4340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00e970 tx=0x7fa84c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.716+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00ccc0 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.716+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8541a4a50 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.716+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa84c00ce60 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.716+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c010430 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.716+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8541a4f90 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.717+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa854101200 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.719+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa84c004f70 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.719+0000 7fa851ffb640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa8400a32d0 0x7fa8400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.720+0000 7fa853fff640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa8400a32d0 0x7fa8400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.720+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fa84c0d0370 con 0x7fa854102ef0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.720+0000 7fa853fff640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa8400a32d0 0x7fa8400a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa844009230 tx=0x7fa8440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:56.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.727+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa84c054210 con 0x7fa854102ef0 2024-09-19T07:07:56.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.907+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa854109090 con 0x7fa854102ef0 2024-09-19T07:07:56.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.908+0000 7fa851ffb640 1 -- 172.21.15.29:0/1245395240 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa84c09cbd0 con 0x7fa854102ef0 2024-09-19T07:07:56.909 INFO:teuthology.orchestra.run.smithi029.stdout:158913790016 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa8400a32d0 msgr2=0x7fa8400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa8400a32d0 0x7fa8400a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa844009230 tx=0x7fa8440058d0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 msgr2=0x7fa8541a4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 0x7fa8541a4340 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00e970 tx=0x7fa84c00ed70 comp rx=0 tx=0).stop 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 shutdown_connections 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa854102ef0 0x7fa8541a4340 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa8400a32d0 0x7fa8400a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa854102570 0x7fa854199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 --2- 172.21.15.29:0/1245395240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa854100e20 0x7fa8541992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:56.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 >> 172.21.15.29:0/1245395240 conn(0x7fa8540fc7d0 msgr2=0x7fa8540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:56.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 shutdown_connections 2024-09-19T07:07:56.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.910+0000 7fa85a920640 1 -- 172.21.15.29:0/1245395240 wait complete. 2024-09-19T07:07:57.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 -- 172.21.15.29:0/2015546908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 msgr2=0x7fc3381067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:57.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 --2- 172.21.15.29:0/2015546908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381067f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc320009900 tx=0x7fc32002a410 comp rx=0 tx=0).stop 2024-09-19T07:07:57.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 -- 172.21.15.29:0/2015546908 shutdown_connections 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 --2- 172.21.15.29:0/2015546908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc338106f20 0x7fc33810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 --2- 172.21.15.29:0/2015546908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381067f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 --2- 172.21.15.29:0/2015546908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 0x7fc3381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 -- 172.21.15.29:0/2015546908 >> 172.21.15.29:0/2015546908 conn(0x7fc3380fd8f0 msgr2=0x7fc3380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 -- 172.21.15.29:0/2015546908 shutdown_connections 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.039+0000 7fc33e534640 1 -- 172.21.15.29:0/2015546908 wait complete. 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.040+0000 7fc33e534640 1 Processor -- start 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.040+0000 7fc33e534640 1 -- start start 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33e534640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 0x7fc3381a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33e534640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33e534640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc338106f20 0x7fc33810dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33e534640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc338111e30 con 0x7fc3381027a0 2024-09-19T07:07:57.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33e534640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc338111cb0 con 0x7fc338101df0 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33e534640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc338111fb0 con 0x7fc338106f20 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46248/0 (socket says 172.21.15.29:46248) 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc32ffff640 1 -- 172.21.15.29:0/659991198 learned_addr learned my addr 172.21.15.29:0/659991198 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc337fff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 0x7fc3381a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc33cad1640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc338106f20 0x7fc33810dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc337fff640 1 -- 172.21.15.29:0/659991198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc338106f20 msgr2=0x7fc33810dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc337fff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc338106f20 0x7fc33810dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc337fff640 1 -- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 msgr2=0x7fc3381a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc337fff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc337fff640 1 -- 172.21.15.29:0/659991198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33810e470 con 0x7fc338101df0 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.041+0000 7fc32ffff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:07:57.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.042+0000 7fc337fff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 0x7fc3381a4620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc32800e9f0 tx=0x7fc32800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.042+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32800ccc0 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.042+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33810e760 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.042+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3280108e0 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.042+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328018880 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.042+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3381ab480 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.043+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3381032d0 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.044+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc328010a90 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.045+0000 7fc335ffb640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3240a32d0 0x7fc3240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.045+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fc3280d0270 con 0x7fc338101df0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.045+0000 7fc32ffff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3240a32d0 0x7fc3240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.045+0000 7fc32ffff640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3240a32d0 0x7fc3240a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc320031440 tx=0x7fc3200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:07:57.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.048+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc32809c420 con 0x7fc338101df0 2024-09-19T07:07:57.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.224+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc338105ee0 con 0x7fc338101df0 2024-09-19T07:07:57.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.225+0000 7fc335ffb640 1 -- 172.21.15.29:0/659991198 <== mon.2 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3280a0720 con 0x7fc338101df0 2024-09-19T07:07:57.226 INFO:teuthology.orchestra.run.smithi029.stdout:103079215177 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3240a32d0 msgr2=0x7fc3240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3240a32d0 0x7fc3240a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc320031440 tx=0x7fc3200058d0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 msgr2=0x7fc3381a4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 0x7fc3381a4620 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc32800e9f0 tx=0x7fc32800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 shutdown_connections 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3240a32d0 0x7fc3240a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc338106f20 0x7fc33810dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3381027a0 0x7fc3381a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 --2- 172.21.15.29:0/659991198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc338101df0 0x7fc3381a4620 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 >> 172.21.15.29:0/659991198 conn(0x7fc3380fd8f0 msgr2=0x7fc3380fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 shutdown_connections 2024-09-19T07:07:57.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:57.227+0000 7fc33e534640 1 -- 172.21.15.29:0/659991198 wait complete. 2024-09-19T07:07:57.867 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:57 smithi029 ceph-mon[31255]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:57.867 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:57 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/733853376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:07:57.867 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:57 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4235436756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:07:57.867 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:57 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1245395240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:07:57.867 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:57 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/659991198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:07:57.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:57 smithi078 ceph-mon[34556]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:57 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/733853376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:07:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:57 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4235436756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:07:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:57 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1245395240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:07:57.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:57 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/659991198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:07:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:57 smithi046 ceph-mon[34147]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:07:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:57 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/733853376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:07:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:57 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4235436756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:07:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:57 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1245395240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:07:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:57 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/659991198' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:07:58.219 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561079 got 188978561081 for osd.6 2024-09-19T07:07:58.219 DEBUG:teuthology.parallel:result is None 2024-09-19T07:07:58.635 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790013 got 158913790016 for osd.5 2024-09-19T07:07:58.635 DEBUG:teuthology.parallel:result is None 2024-09-19T07:07:58.857 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:58.858 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:58.858 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:58.858 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:07:59.451 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514526 got 326417514527 for osd.11 2024-09-19T07:07:59.451 DEBUG:teuthology.parallel:result is None 2024-09-19T07:07:59.847 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:59 smithi029 ceph-mon[31255]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:59.847 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:07:59 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/740343471' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:07:59.876 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215175 got 103079215177 for osd.3 2024-09-19T07:07:59.876 DEBUG:teuthology.parallel:result is None 2024-09-19T07:07:59.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:59 smithi078 ceph-mon[34556]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:59.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:07:59 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/740343471' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:07:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:59 smithi046 ceph-mon[34147]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:07:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:07:59 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/740343471' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 -- 172.21.15.29:0/3525880716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd9010e480 msgr2=0x7fcd90110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 --2- 172.21.15.29:0/3525880716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd9010e480 0x7fcd90110870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009ca0 tx=0x7fcd8802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 -- 172.21.15.29:0/3525880716 shutdown_connections 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 --2- 172.21.15.29:0/3525880716 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd9010e480 0x7fcd90110870 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 --2- 172.21.15.29:0/3525880716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd90101280 0x7fcd9010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 --2- 172.21.15.29:0/3525880716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd901008d0 0x7fcd90100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 -- 172.21.15.29:0/3525880716 >> 172.21.15.29:0/3525880716 conn(0x7fcd900fc7a0 msgr2=0x7fcd900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 -- 172.21.15.29:0/3525880716 shutdown_connections 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.042+0000 7fcd97614640 1 -- 172.21.15.29:0/3525880716 wait complete. 2024-09-19T07:08:00.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 Processor -- start 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 -- start start 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 0x7fcd9019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd90101280 0x7fcd9019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9010e480 0x7fcd9019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fcd90114020 con 0x7fcd901008d0 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd90113ea0 con 0x7fcd9010e480 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.043+0000 7fcd97614640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd901141a0 con 0x7fcd90101280 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 0x7fcd9019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 0x7fcd9019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46264/0 (socket says 172.21.15.29:46264) 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 -- 172.21.15.29:0/740343471 learned_addr learned my addr 172.21.15.29:0/740343471 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd94baf640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd90101280 0x7fcd9019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd95bb1640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9010e480 0x7fcd9019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 -- 172.21.15.29:0/740343471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd90101280 msgr2=0x7fcd9019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd90101280 0x7fcd9019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 -- 172.21.15.29:0/740343471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9010e480 msgr2=0x7fcd9019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9010e480 0x7fcd9019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 -- 172.21.15.29:0/740343471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9019f530 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd953b0640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 0x7fcd9019a580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c970 tx=0x7fcd8c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c007bb0 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9019f820 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd8c007d50 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c00f450 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.044+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd901a7100 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.045+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd90100cb0 con 0x7fcd901008d0 2024-09-19T07:08:00.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.046+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcd8c004f20 con 0x7fcd901008d0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.047+0000 7fcd867fc640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd7c0a32d0 0x7fcd7c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.047+0000 7fcd94baf640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd7c0a32d0 0x7fcd7c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.047+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fcd8c0cfb30 con 0x7fcd901008d0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.048+0000 7fcd94baf640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd7c0a32d0 0x7fcd7c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd9010e8a0 tx=0x7fcd8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.051+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd8c014030 con 0x7fcd901008d0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.229+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcd90109640 con 0x7fcd901008d0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.229+0000 7fcd867fc640 1 -- 172.21.15.29:0/740343471 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd8c09bce0 con 0x7fcd901008d0 2024-09-19T07:08:00.095 INFO:teuthology.orchestra.run.smithi029.stdout:137438953541 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd7c0a32d0 msgr2=0x7fcd7c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd7c0a32d0 0x7fcd7c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd9010e8a0 tx=0x7fcd8000b410 comp rx=0 tx=0).stop 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 msgr2=0x7fcd9019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 0x7fcd9019a580 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c970 tx=0x7fcd8c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 shutdown_connections 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd9010e480 0x7fcd9019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fcd7c0a32d0 0x7fcd7c0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd90101280 0x7fcd9019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 --2- 172.21.15.29:0/740343471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd901008d0 0x7fcd9019a580 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.232+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 >> 172.21.15.29:0/740343471 conn(0x7fcd900fc7a0 msgr2=0x7fcd9010f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.233+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 shutdown_connections 2024-09-19T07:08:00.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:59.233+0000 7fcd97614640 1 -- 172.21.15.29:0/740343471 wait complete. 2024-09-19T07:08:00.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 -- 172.21.15.29:0/2965953575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1068d0 msgr2=0x7f02cc106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 --2- 172.21.15.29:0/2965953575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1068d0 0x7f02cc106cb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009930 tx=0x7f02c802a420 comp rx=0 tx=0).stop 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 -- 172.21.15.29:0/2965953575 shutdown_connections 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 --2- 172.21.15.29:0/2965953575 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02cc101270 0x7f02cc10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 --2- 172.21.15.29:0/2965953575 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02cc1008d0 0x7f02cc100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 --2- 172.21.15.29:0/2965953575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1068d0 0x7f02cc106cb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 -- 172.21.15.29:0/2965953575 >> 172.21.15.29:0/2965953575 conn(0x7f02cc0fc610 msgr2=0x7f02cc0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 -- 172.21.15.29:0/2965953575 shutdown_connections 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.379+0000 7f02d33a0640 1 -- 172.21.15.29:0/2965953575 wait complete. 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 Processor -- start 2024-09-19T07:08:00.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 -- start start 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 0x7f02cc198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02cc101270 0x7f02cc1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02cc1068d0 0x7f02cc1a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc110b80 con 0x7f02cc1008d0 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc110a00 con 0x7f02cc101270 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d33a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc110d00 con 0x7f02cc1068d0 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d239e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 0x7f02cc198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d239e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 0x7f02cc198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46206/0 (socket says 172.21.15.29:46206) 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.380+0000 7f02d239e640 1 -- 172.21.15.29:0/733853376 learned_addr learned my addr 172.21.15.29:0/733853376 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d2b9f640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02cc1068d0 0x7f02cc1a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d1b9d640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02cc101270 0x7f02cc1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d239e640 1 -- 172.21.15.29:0/733853376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02cc1068d0 msgr2=0x7f02cc1a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d239e640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02cc1068d0 0x7f02cc1a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d239e640 1 -- 172.21.15.29:0/733853376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02cc101270 msgr2=0x7f02cc1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d239e640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02cc101270 0x7f02cc1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d239e640 1 -- 172.21.15.29:0/733853376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc1a4550 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d239e640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 0x7f02cc198f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f02c8004770 tx=0x7f02c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c803f070 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f02c803b460 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc1a4720 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c8035070 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.381+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc1a4b70 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.382+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02cc100d30 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.383+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f02c803b610 con 0x7f02cc1008d0 2024-09-19T07:08:00.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.384+0000 7f02bf7fe640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f02b80a32d0 0x7f02b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.384+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f02c80f0240 con 0x7f02cc1008d0 2024-09-19T07:08:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.384+0000 7f02d1b9d640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f02b80a32d0 0x7f02b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.385+0000 7f02d1b9d640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f02b80a32d0 0x7f02b80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005e10 tx=0x7f02c0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.389+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02c80bcaa0 con 0x7f02cc1008d0 2024-09-19T07:08:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.605+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f02cc108e40 con 0x7f02cc1008d0 2024-09-19T07:08:00.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.605+0000 7f02bf7fe640 1 -- 172.21.15.29:0/733853376 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02c80bc3a0 con 0x7f02cc1008d0 2024-09-19T07:08:00.536 INFO:teuthology.orchestra.run.smithi029.stdout:34359738456 2024-09-19T07:08:00.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f02b80a32d0 msgr2=0x7f02b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f02b80a32d0 0x7f02b80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005e10 tx=0x7f02c0005da0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 msgr2=0x7f02cc198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 0x7f02cc198f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f02c8004770 tx=0x7f02c80042f0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 shutdown_connections 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f02b80a32d0 0x7f02b80a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02cc1068d0 0x7f02cc1a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f02cc101270 0x7f02cc1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 --2- 172.21.15.29:0/733853376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02cc1008d0 0x7f02cc198f90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 >> 172.21.15.29:0/733853376 conn(0x7f02cc0fc610 msgr2=0x7f02cc0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:00.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 shutdown_connections 2024-09-19T07:08:00.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:07:56.607+0000 7f02d33a0640 1 -- 172.21.15.29:0/733853376 wait complete. 2024-09-19T07:08:01.470 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738456 for osd.0 2024-09-19T07:08:01.470 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:01.714 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:01 smithi029 ceph-mon[31255]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:01.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:01 smithi078 ceph-mon[34556]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:01.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:01 smithi046 ceph-mon[34147]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:02.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 -- 172.21.15.29:0/838227314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 msgr2=0x7f2c0c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 --2- 172.21.15.29:0/838227314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c106840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009930 tx=0x7f2bfc02a420 comp rx=0 tx=0).stop 2024-09-19T07:08:02.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 -- 172.21.15.29:0/838227314 shutdown_connections 2024-09-19T07:08:02.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 --2- 172.21.15.29:0/838227314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c106f50 0x7f2c0c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 --2- 172.21.15.29:0/838227314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c106840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 --2- 172.21.15.29:0/838227314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c0c100350 0x7f2c0c100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 -- 172.21.15.29:0/838227314 >> 172.21.15.29:0/838227314 conn(0x7f2c0c077210 msgr2=0x7f2c0c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 -- 172.21.15.29:0/838227314 shutdown_connections 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.152+0000 7f2c145d0640 1 -- 172.21.15.29:0/838227314 wait complete. 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 Processor -- start 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 -- start start 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c100350 0x7f2c0c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c0c106f50 0x7f2c0c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c111e50 con 0x7f2c0c100d00 2024-09-19T07:08:02.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c111cd0 con 0x7f2c0c106f50 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c145d0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c111fd0 con 0x7f2c0c100350 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46288/0 (socket says 172.21.15.29:46288) 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 -- 172.21.15.29:0/287795788 learned_addr learned my addr 172.21.15.29:0/287795788 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c12b6d640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c0c106f50 0x7f2c0c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c1236c640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c100350 0x7f2c0c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 -- 172.21.15.29:0/287795788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c100350 msgr2=0x7f2c0c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c100350 0x7f2c0c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 -- 172.21.15.29:0/287795788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c0c106f50 msgr2=0x7f2c0c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c0c106f50 0x7f2c0c19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.153+0000 7f2c11b6b640 1 -- 172.21.15.29:0/287795788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c19d3d0 con 0x7f2c0c100d00 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.154+0000 7f2c11b6b640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c198960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc031440 tx=0x7f2bfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:02.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.154+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc03f030 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.154+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c19d660 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.154+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2bfc003aa0 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.154+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc035070 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.154+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1a4fa0 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.155+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0c100730 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.156+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2bfc042030 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.157+0000 7f2c037fe640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2bf80a32d0 0x7f2bf80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.157+0000 7f2c1236c640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2bf80a32d0 0x7f2bf80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.157+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f2bfc0f07a0 con 0x7f2c0c100d00 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.157+0000 7f2c1236c640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2bf80a32d0 0x7f2bf80a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009bd0 tx=0x7f2c08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:02.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.160+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bfc0bc9b0 con 0x7f2c0c100d00 2024-09-19T07:08:02.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.339+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2c0c10a150 con 0x7f2c0c100d00 2024-09-19T07:08:02.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.339+0000 7f2c037fe640 1 -- 172.21.15.29:0/287795788 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2bfc0c0cb0 con 0x7f2c0c100d00 2024-09-19T07:08:02.340 INFO:teuthology.orchestra.run.smithi029.stdout:210453397557 2024-09-19T07:08:02.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2bf80a32d0 msgr2=0x7f2bf80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2bf80a32d0 0x7f2bf80a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009bd0 tx=0x7f2c08005f90 comp rx=0 tx=0).stop 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 msgr2=0x7f2c0c198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c198960 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc031440 tx=0x7f2bfc004270 comp rx=0 tx=0).stop 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 shutdown_connections 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c0c106f50 0x7f2c0c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c100d00 0x7f2c0c198960 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f2bf80a32d0 0x7f2bf80a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 --2- 172.21.15.29:0/287795788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c100350 0x7f2c0c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 >> 172.21.15.29:0/287795788 conn(0x7f2c0c077210 msgr2=0x7f2c0c105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 shutdown_connections 2024-09-19T07:08:02.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.342+0000 7f2c145d0640 1 -- 172.21.15.29:0/287795788 wait complete. 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 -- 172.21.15.29:0/1905247103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c010c180 msgr2=0x7f73c010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1905247103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c010c180 0x7f73c010e620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f73b8009ca0 tx=0x7f73b802a950 comp rx=0 tx=0).stop 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 -- 172.21.15.29:0/1905247103 shutdown_connections 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1905247103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c010c180 0x7f73c010e620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1905247103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73c0103670 0x7f73c010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1905247103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 0x7f73c0103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 -- 172.21.15.29:0/1905247103 >> 172.21.15.29:0/1905247103 conn(0x7f73c00fc7d0 msgr2=0x7f73c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 -- 172.21.15.29:0/1905247103 shutdown_connections 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.373+0000 7f73c52b4640 1 -- 172.21.15.29:0/1905247103 wait complete. 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 Processor -- start 2024-09-19T07:08:02.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 -- start start 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 0x7f73c0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 0x7f73c0198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73c010c180 0x7f73c019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0111e30 con 0x7f73c0103670 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0111cb0 con 0x7f73c010c180 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73c52b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73c0111fb0 con 0x7f73c0102d50 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 0x7f73c0198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 0x7f73c0198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46316/0 (socket says 172.21.15.29:46316) 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.374+0000 7f73be7fc640 1 -- 172.21.15.29:0/1791498307 learned_addr learned my addr 172.21.15.29:0/1791498307 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73bf7fe640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73c010c180 0x7f73c019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73beffd640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 0x7f73c0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73be7fc640 1 -- 172.21.15.29:0/1791498307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 msgr2=0x7f73c0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73be7fc640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 0x7f73c0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73be7fc640 1 -- 172.21.15.29:0/1791498307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73c010c180 msgr2=0x7f73c019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73be7fc640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73c010c180 0x7f73c019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73be7fc640 1 -- 172.21.15.29:0/1791498307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c019d2d0 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73beffd640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 0x7f73c0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73be7fc640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 0x7f73c0198860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f73b400e9f0 tx=0x7f73b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b400ccc0 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c019d5c0 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73b40108e0 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b40187c0 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.375+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c01a4ea0 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.376+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c0103130 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.378+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f73b4010430 con 0x7f73c0103670 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.379+0000 7f73a7fff640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73a80a32d0 0x7f73a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:02.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.379+0000 7f73beffd640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73a80a32d0 0x7f73a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:02.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.379+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f73b40d05e0 con 0x7f73c0103670 2024-09-19T07:08:02.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.379+0000 7f73beffd640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73a80a32d0 0x7f73a80a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009c20 tx=0x7f73b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:02.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.386+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73b409ce40 con 0x7f73c0103670 2024-09-19T07:08:02.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.565+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f73c0107280 con 0x7f73c0103670 2024-09-19T07:08:02.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.565+0000 7f73a7fff640 1 -- 172.21.15.29:0/1791498307 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f73b409c740 con 0x7f73c0103670 2024-09-19T07:08:02.566 INFO:teuthology.orchestra.run.smithi029.stdout:55834574934 2024-09-19T07:08:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.567+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73a80a32d0 msgr2=0x7f73a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.567+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73a80a32d0 0x7f73a80a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009c20 tx=0x7f73b0005f90 comp rx=0 tx=0).stop 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.567+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 msgr2=0x7f73c0198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.567+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 0x7f73c0198860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f73b400e9f0 tx=0x7f73b400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 shutdown_connections 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73c010c180 0x7f73c019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73c0103670 0x7f73c0198860 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73a80a32d0 0x7f73a80a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 --2- 172.21.15.29:0/1791498307 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73c0102d50 0x7f73c0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:02.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 >> 172.21.15.29:0/1791498307 conn(0x7f73c00fc7d0 msgr2=0x7f73c00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 shutdown_connections 2024-09-19T07:08:02.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:02.568+0000 7f73c52b4640 1 -- 172.21.15.29:0/1791498307 wait complete. 2024-09-19T07:08:02.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:02 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/287795788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:08:02.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:02 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1791498307' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:08:02.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:02 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/287795788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:08:02.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:02 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1791498307' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:08:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:02 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/287795788' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:08:02.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:02 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1791498307' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:08:03.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:03 smithi029 ceph-mon[31255]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:03.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:03 smithi078 ceph-mon[34556]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:03 smithi046 ceph-mon[34147]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:04.132 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397553 got 210453397557 for osd.7 2024-09-19T07:08:04.132 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:04.645 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574930 got 55834574934 for osd.1 2024-09-19T07:08:04.646 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:04.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.835+0000 7f06856af640 1 -- 172.21.15.29:0/1554345908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0680102d30 msgr2=0x7f0680103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:04.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 --2- 172.21.15.29:0/1554345908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0680102d30 0x7f0680103110 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0670009cd0 tx=0x7f067002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 -- 172.21.15.29:0/1554345908 shutdown_connections 2024-09-19T07:08:04.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 --2- 172.21.15.29:0/1554345908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06801082a0 0x7f068010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 --2- 172.21.15.29:0/1554345908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06801036e0 0x7f0680107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 --2- 172.21.15.29:0/1554345908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0680102d30 0x7f0680103110 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 -- 172.21.15.29:0/1554345908 >> 172.21.15.29:0/1554345908 conn(0x7f06800fc7d0 msgr2=0x7f06800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 -- 172.21.15.29:0/1554345908 shutdown_connections 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 -- 172.21.15.29:0/1554345908 wait complete. 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.836+0000 7f06856af640 1 Processor -- start 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 -- start start 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0680102d30 0x7f06801984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 0x7f0680198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06801082a0 0x7f068019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0680111f50 con 0x7f06801036e0 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0680111dd0 con 0x7f0680102d30 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f06856af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06801120d0 con 0x7f06801082a0 2024-09-19T07:08:04.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 0x7f0680198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 0x7f0680198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46332/0 (socket says 172.21.15.29:46332) 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 -- 172.21.15.29:0/2553199544 learned_addr learned my addr 172.21.15.29:0/2553199544 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067effd640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0680102d30 0x7f06801984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067f7fe640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06801082a0 0x7f068019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 -- 172.21.15.29:0/2553199544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06801082a0 msgr2=0x7f068019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06801082a0 0x7f068019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 -- 172.21.15.29:0/2553199544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0680102d30 msgr2=0x7f06801984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0680102d30 0x7f06801984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.837+0000 7f067e7fc640 1 -- 172.21.15.29:0/2553199544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068019d4a0 con 0x7f06801036e0 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.838+0000 7f067e7fc640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 0x7f0680198a30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f067400d750 tx=0x7f067400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.838+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674017070 con 0x7f06801036e0 2024-09-19T07:08:04.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.838+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f06740054d0 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.838+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068019d790 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.838+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674004cf0 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.838+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06801a5070 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.839+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068006a850 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.840+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0674004e90 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.841+0000 7f0667fff640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f06680a3350 0x7f06680a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.841+0000 7f067effd640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f06680a3350 0x7f06680a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.841+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f06740cfae0 con 0x7f06801036e0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.842+0000 7f067effd640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f06680a3350 0x7f06680a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0670006010 tx=0x7f06700099c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:04.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:04.845+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f067409bd10 con 0x7f06801036e0 2024-09-19T07:08:05.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.026+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f068010a2b0 con 0x7f06801036e0 2024-09-19T07:08:05.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.026+0000 7f0667fff640 1 -- 172.21.15.29:0/2553199544 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f06740a0010 con 0x7f06801036e0 2024-09-19T07:08:05.027 INFO:teuthology.orchestra.run.smithi029.stdout:296352743462 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f06680a3350 msgr2=0x7f06680a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f06680a3350 0x7f06680a5810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0670006010 tx=0x7f06700099c0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 msgr2=0x7f0680198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 0x7f0680198a30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f067400d750 tx=0x7f067400dc10 comp rx=0 tx=0).stop 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 shutdown_connections 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f06680a3350 0x7f06680a5810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06801082a0 0x7f068019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f06801036e0 0x7f0680198a30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 --2- 172.21.15.29:0/2553199544 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0680102d30 0x7f06801984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.028+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 >> 172.21.15.29:0/2553199544 conn(0x7f06800fc7d0 msgr2=0x7f0680105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.029+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 shutdown_connections 2024-09-19T07:08:05.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.029+0000 7f06856af640 1 -- 172.21.15.29:0/2553199544 wait complete. 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.059+0000 7f22e40d7640 1 -- 172.21.15.29:0/2932633707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc10e3b0 msgr2=0x7f22dc110800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.059+0000 7f22e40d7640 1 --2- 172.21.15.29:0/2932633707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc10e3b0 0x7f22dc110800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009ca0 tx=0x7f22d402a950 comp rx=0 tx=0).stop 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 -- 172.21.15.29:0/2932633707 shutdown_connections 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 --2- 172.21.15.29:0/2932633707 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc10e3b0 0x7f22dc110800 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 --2- 172.21.15.29:0/2932633707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc074f40 0x7f22dc10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 --2- 172.21.15.29:0/2932633707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22dc074620 0x7f22dc074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 -- 172.21.15.29:0/2932633707 >> 172.21.15.29:0/2932633707 conn(0x7f22dc0fd8b0 msgr2=0x7f22dc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 -- 172.21.15.29:0/2932633707 shutdown_connections 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 -- 172.21.15.29:0/2932633707 wait complete. 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.060+0000 7f22e40d7640 1 Processor -- start 2024-09-19T07:08:05.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 -- start start 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 0x7f22dc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22dc074f40 0x7f22dc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc10e3b0 0x7f22dc19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 0x7f22dc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc114010 con 0x7f22dc074620 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 0x7f22dc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:46354/0 (socket says 172.21.15.29:46354) 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc113e90 con 0x7f22dc074f40 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 -- 172.21.15.29:0/3846000844 learned_addr learned my addr 172.21.15.29:0/3846000844 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc114190 con 0x7f22dc10e3b0 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e2674640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc10e3b0 0x7f22dc19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1672640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22dc074f40 0x7f22dc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:05.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 -- 172.21.15.29:0/3846000844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc10e3b0 msgr2=0x7f22dc19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc10e3b0 0x7f22dc19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 -- 172.21.15.29:0/3846000844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22dc074f40 msgr2=0x7f22dc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22dc074f40 0x7f22dc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e1e73640 1 -- 172.21.15.29:0/3846000844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc19f510 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.061+0000 7f22e2674640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc10e3b0 0x7f22dc19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.062+0000 7f22e1e73640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 0x7f22dc19a560 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f22d800d950 tx=0x7f22d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.062+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8017070 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.062+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f22d8009c30 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.062+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc19f800 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.062+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc1a70e0 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.062+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d800f620 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.063+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc074a00 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.064+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f22d80109a0 con 0x7f22dc074620 2024-09-19T07:08:05.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.065+0000 7f22d2ffd640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f22c80a32d0 0x7f22c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.065+0000 7f22e1672640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f22c80a32d0 0x7f22c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.065+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f22d80cfb70 con 0x7f22dc074620 2024-09-19T07:08:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.065+0000 7f22e1672640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f22c80a32d0 0x7f22c80a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0fffb0 tx=0x7f22cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:05.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.069+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22d8009de0 con 0x7f22dc074620 2024-09-19T07:08:05.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.262+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f22dc109560 con 0x7f22dc074620 2024-09-19T07:08:05.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.262+0000 7f22d2ffd640 1 -- 172.21.15.29:0/3846000844 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f22d809c370 con 0x7f22dc074620 2024-09-19T07:08:05.263 INFO:teuthology.orchestra.run.smithi029.stdout:240518168626 2024-09-19T07:08:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f22c80a32d0 msgr2=0x7f22c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f22c80a32d0 0x7f22c80a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0fffb0 tx=0x7f22cc005f90 comp rx=0 tx=0).stop 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 msgr2=0x7f22dc19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 0x7f22dc19a560 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f22d800d950 tx=0x7f22d800de10 comp rx=0 tx=0).stop 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 shutdown_connections 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f22c80a32d0 0x7f22c80a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f22dc10e3b0 0x7f22dc19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22dc074f40 0x7f22dc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 --2- 172.21.15.29:0/3846000844 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f22dc074620 0x7f22dc19a560 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 >> 172.21.15.29:0/3846000844 conn(0x7f22dc0fd8b0 msgr2=0x7f22dc0ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 shutdown_connections 2024-09-19T07:08:05.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:05.264+0000 7f22e40d7640 1 -- 172.21.15.29:0/3846000844 wait complete. 2024-09-19T07:08:05.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:05 smithi029 ceph-mon[31255]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:05.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:05 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2553199544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:08:05.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:05 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3846000844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:08:05.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:05 smithi078 ceph-mon[34556]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:05.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:05 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2553199544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:08:05.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:05 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3846000844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:08:05.946 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743457 got 296352743462 for osd.10 2024-09-19T07:08:05.947 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:05 smithi046 ceph-mon[34147]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:05 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2553199544' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:08:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:05 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3846000844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:08:06.004 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:06.600 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953539 got 137438953541 for osd.4 2024-09-19T07:08:06.600 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:07.278 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168623 got 240518168626 for osd.8 2024-09-19T07:08:07.279 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.741+0000 7f35f4ece640 1 -- 172.21.15.29:0/524685179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 msgr2=0x7f35f0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.741+0000 7f35f4ece640 1 --2- 172.21.15.29:0/524685179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f0103120 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009900 tx=0x7f35e002a480 comp rx=0 tx=0).stop 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 -- 172.21.15.29:0/524685179 shutdown_connections 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 --2- 172.21.15.29:0/524685179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f010c170 0x7f35f010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 --2- 172.21.15.29:0/524685179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f0103660 0x7f35f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 --2- 172.21.15.29:0/524685179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f0103120 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 -- 172.21.15.29:0/524685179 >> 172.21.15.29:0/524685179 conn(0x7f35f00fc7a0 msgr2=0x7f35f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:07.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 -- 172.21.15.29:0/524685179 shutdown_connections 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 -- 172.21.15.29:0/524685179 wait complete. 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 Processor -- start 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.742+0000 7f35f4ece640 1 -- start start 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35f4ece640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35f4ece640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f0103660 0x7f35f0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35f4ece640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f010c170 0x7f35f0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35f4ece640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0111eb0 con 0x7f35f0102d40 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35f4ece640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0111d30 con 0x7f35f010c170 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35f4ece640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0112030 con 0x7f35f0103660 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:07.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39208/0 (socket says 172.21.15.29:39208) 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 -- 172.21.15.29:0/4142078878 learned_addr learned my addr 172.21.15.29:0/4142078878 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35eed9d640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f010c170 0x7f35f0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35edd9b640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f0103660 0x7f35f0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 -- 172.21.15.29:0/4142078878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f0103660 msgr2=0x7f35f0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f0103660 0x7f35f0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 -- 172.21.15.29:0/4142078878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f010c170 msgr2=0x7f35f0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f010c170 0x7f35f0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 -- 172.21.15.29:0/4142078878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01a68d0 con 0x7f35f0102d40 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.743+0000 7f35ee59c640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f01009a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35e0005ab0 tx=0x7f35e0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.744+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e003f070 con 0x7f35f0102d40 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.744+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35e0031d60 con 0x7f35f0102d40 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.744+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f01a6b60 con 0x7f35f0102d40 2024-09-19T07:08:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.744+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e0035030 con 0x7f35f0102d40 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.744+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f01a7090 con 0x7f35f0102d40 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.745+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f0103120 con 0x7f35f0102d40 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.746+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f35e0042070 con 0x7f35f0102d40 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.747+0000 7f35df7fe640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f35d80a3350 0x7f35d80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.747+0000 7f35edd9b640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f35d80a3350 0x7f35d80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.747+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f35e00f0630 con 0x7f35f0102d40 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.747+0000 7f35edd9b640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f35d80a3350 0x7f35d80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35f0102430 tx=0x7f35e400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.751+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f35e00bc7e0 con 0x7f35f0102d40 2024-09-19T07:08:07.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:07 smithi029 ceph-mon[31255]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:07.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.931+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f35f01071e0 con 0x7f35f0102d40 2024-09-19T07:08:07.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.931+0000 7f35df7fe640 1 -- 172.21.15.29:0/4142078878 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f35e00c0ae0 con 0x7f35f0102d40 2024-09-19T07:08:07.933 INFO:teuthology.orchestra.run.smithi029.stdout:274877906986 2024-09-19T07:08:07.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f35d80a3350 msgr2=0x7f35d80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:07.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f35d80a3350 0x7f35d80a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35f0102430 tx=0x7f35e400d040 comp rx=0 tx=0).stop 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 msgr2=0x7f35f01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f01009a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35e0005ab0 tx=0x7f35e0003cd0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 shutdown_connections 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35f010c170 0x7f35f0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f35d80a3350 0x7f35d80a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f35f0103660 0x7f35f0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 --2- 172.21.15.29:0/4142078878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35f0102d40 0x7f35f01009a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 >> 172.21.15.29:0/4142078878 conn(0x7f35f00fc7a0 msgr2=0x7f35f00fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 shutdown_connections 2024-09-19T07:08:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:07.934+0000 7f35f4ece640 1 -- 172.21.15.29:0/4142078878 wait complete. 2024-09-19T07:08:07.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:07 smithi078 ceph-mon[34556]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:07 smithi046 ceph-mon[34147]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-19T07:08:08.663 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906982 got 274877906986 for osd.9 2024-09-19T07:08:08.663 DEBUG:teuthology.parallel:result is None 2024-09-19T07:08:08.663 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:08:08.664 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:08:08.933 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:08.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:08 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4142078878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:08:08.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:08 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4142078878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:08:09.054 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:08 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4142078878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:08:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 -- 172.21.15.29:0/596573568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 msgr2=0x7f8de010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 --2- 172.21.15.29:0/596573568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de010bb50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009900 tx=0x7f8dd402a480 comp rx=0 tx=0).stop 2024-09-19T07:08:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 -- 172.21.15.29:0/596573568 shutdown_connections 2024-09-19T07:08:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 --2- 172.21.15.29:0/596573568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de010c170 0x7f8de010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 --2- 172.21.15.29:0/596573568 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de010bb50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 --2- 172.21.15.29:0/596573568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8de0102d40 0x7f8de0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 -- 172.21.15.29:0/596573568 >> 172.21.15.29:0/596573568 conn(0x7f8de00fc7a0 msgr2=0x7f8de00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.434+0000 7f8de4d88640 1 -- 172.21.15.29:0/596573568 shutdown_connections 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.435+0000 7f8de4d88640 1 -- 172.21.15.29:0/596573568 wait complete. 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.435+0000 7f8de4d88640 1 Processor -- start 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.435+0000 7f8de4d88640 1 -- start start 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de0102d40 0x7f8de01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8de010c170 0x7f8de019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0111e60 con 0x7f8de0103660 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0111ce0 con 0x7f8de0102d40 2024-09-19T07:08:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0111fe0 con 0x7f8de010c170 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de0198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39236/0 (socket says 172.21.15.29:39236) 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 -- 172.21.15.29:0/1037677104 learned_addr learned my addr 172.21.15.29:0/1037677104 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dded9d640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8de010c170 0x7f8de019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dde59c640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de0102d40 0x7f8de01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 -- 172.21.15.29:0/1037677104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8de010c170 msgr2=0x7f8de019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8de010c170 0x7f8de019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 -- 172.21.15.29:0/1037677104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de0102d40 msgr2=0x7f8de01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de0102d40 0x7f8de01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 -- 172.21.15.29:0/1037677104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de019d3a0 con 0x7f8de0103660 2024-09-19T07:08:09.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dde59c640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de0102d40 0x7f8de01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dddd9b640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de0198930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005940 tx=0x7f8dd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd403f030 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de019d630 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8dd4003cb0 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.436+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4035070 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.437+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de01a4f70 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.437+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de006b070 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.439+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8dd4042030 con 0x7f8de0103660 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.440+0000 7f8dcf7fe640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8dc80a32d0 0x7f8dc80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.440+0000 7f8dde59c640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8dc80a32d0 0x7f8dc80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.440+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f8dd40f0670 con 0x7f8de0103660 2024-09-19T07:08:09.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.440+0000 7f8dde59c640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8dc80a32d0 0x7f8dc80a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0006fd0 tx=0x7f8dd0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:09.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.444+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dd40bced0 con 0x7f8de0103660 2024-09-19T07:08:09.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.616+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8de0107210 con 0x7f8dc80a32d0 2024-09-19T07:08:09.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.625+0000 7f8dcf7fe640 1 -- 172.21.15.29:0/1037677104 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340289 (secure 0 0 0) 0x7f8de0107210 con 0x7f8dc80a32d0 2024-09-19T07:08:09.630 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:09.632 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8dc80a32d0 msgr2=0x7f8dc80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8dc80a32d0 0x7f8dc80a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0006fd0 tx=0x7f8dd0008040 comp rx=0 tx=0).stop 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 msgr2=0x7f8de0198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de0198930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4005940 tx=0x7f8dd40042f0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 shutdown_connections 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f8dc80a32d0 0x7f8dc80a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8de010c170 0x7f8de019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8de0103660 0x7f8de0198930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 --2- 172.21.15.29:0/1037677104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de0102d40 0x7f8de01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 >> 172.21.15.29:0/1037677104 conn(0x7f8de00fc7a0 msgr2=0x7f8de00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 shutdown_connections 2024-09-19T07:08:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:09.629+0000 7f8de4d88640 1 -- 172.21.15.29:0/1037677104 wait complete. 2024-09-19T07:08:09.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:09 smithi029 ceph-mon[31255]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:09.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:09 smithi078 ceph-mon[34556]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:09 smithi046 ceph-mon[34147]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:10.500 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-19T07:08:07.868554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":271,"num_read_kb":246,"num_write":268,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181340,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404816,"kb_used_data":13904,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537008,"statfs":{"total":1151940427776,"available":1151525896192,"internally_reserved":0,"allocated":14237696,"data_stored":8003123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":14,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003522"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.091196+0000","last_change":"2024-09-19T07:07:15.091196+0000","last_active":"2024-09-19T07:07:15.091196+0000","last_peered":"2024-09-19T07:07:15.091196+0000","last_clean":"2024-09-19T07:07:15.091196+0000","last_became_active":"2024-09-19T07:07:15.087619+0000","last_became_peered":"2024-09-19T07:07:15.087619+0000","last_unstale":"2024-09-19T07:07:15.091196+0000","last_undegraded":"2024-09-19T07:07:15.091196+0000","last_fullsized":"2024-09-19T07:07:15.091196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:01.778892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059328+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:07:15.059328+0000","last_peered":"2024-09-19T07:07:15.059328+0000","last_clean":"2024-09-19T07:07:15.059328+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:07:15.059328+0000","last_undegraded":"2024-09-19T07:07:15.059328+0000","last_fullsized":"2024-09-19T07:07:15.059328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059519+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:07:15.059519+0000","last_peered":"2024-09-19T07:07:15.059519+0000","last_clean":"2024-09-19T07:07:15.059519+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:07:15.059519+0000","last_undegraded":"2024-09-19T07:07:15.059519+0000","last_fullsized":"2024-09-19T07:07:15.059519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178223+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:15.178223+0000","last_peered":"2024-09-19T07:07:15.178223+0000","last_clean":"2024-09-19T07:07:15.178223+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:15.178223+0000","last_undegraded":"2024-09-19T07:07:15.178223+0000","last_fullsized":"2024-09-19T07:07:15.178223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060171+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:07:15.060171+0000","last_peered":"2024-09-19T07:07:15.060171+0000","last_clean":"2024-09-19T07:07:15.060171+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:07:15.060171+0000","last_undegraded":"2024-09-19T07:07:15.060171+0000","last_fullsized":"2024-09-19T07:07:15.060171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064869+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:07:15.064869+0000","last_peered":"2024-09-19T07:07:15.064869+0000","last_clean":"2024-09-19T07:07:15.064869+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:07:15.064869+0000","last_undegraded":"2024-09-19T07:07:15.064869+0000","last_fullsized":"2024-09-19T07:07:15.064869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086202+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:15.086202+0000","last_peered":"2024-09-19T07:07:15.086202+0000","last_clean":"2024-09-19T07:07:15.086202+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:15.086202+0000","last_undegraded":"2024-09-19T07:07:15.086202+0000","last_fullsized":"2024-09-19T07:07:15.086202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064418+0000","last_change":"2024-09-19T07:07:15.064418+0000","last_active":"2024-09-19T07:07:15.064418+0000","last_peered":"2024-09-19T07:07:15.064418+0000","last_clean":"2024-09-19T07:07:15.064418+0000","last_became_active":"2024-09-19T07:07:15.063859+0000","last_became_peered":"2024-09-19T07:07:15.063859+0000","last_unstale":"2024-09-19T07:07:15.064418+0000","last_undegraded":"2024-09-19T07:07:15.064418+0000","last_fullsized":"2024-09-19T07:07:15.064418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:22.219231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,10,5],"acting":[4,3,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.065231+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:07:15.065231+0000","last_peered":"2024-09-19T07:07:15.065231+0000","last_clean":"2024-09-19T07:07:15.065231+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:07:15.065231+0000","last_undegraded":"2024-09-19T07:07:15.065231+0000","last_fullsized":"2024-09-19T07:07:15.065231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058483+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:15.058483+0000","last_peered":"2024-09-19T07:07:15.058483+0000","last_clean":"2024-09-19T07:07:15.058483+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:15.058483+0000","last_undegraded":"2024-09-19T07:07:15.058483+0000","last_fullsized":"2024-09-19T07:07:15.058483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060553+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:07:15.060553+0000","last_peered":"2024-09-19T07:07:15.060553+0000","last_clean":"2024-09-19T07:07:15.060553+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:07:15.060553+0000","last_undegraded":"2024-09-19T07:07:15.060553+0000","last_fullsized":"2024-09-19T07:07:15.060553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.072152+0000","last_change":"2024-09-19T07:07:15.072152+0000","last_active":"2024-09-19T07:07:15.072152+0000","last_peered":"2024-09-19T07:07:15.072152+0000","last_clean":"2024-09-19T07:07:15.072152+0000","last_became_active":"2024-09-19T07:07:15.066108+0000","last_became_peered":"2024-09-19T07:07:15.066108+0000","last_unstale":"2024-09-19T07:07:15.072152+0000","last_undegraded":"2024-09-19T07:07:15.072152+0000","last_fullsized":"2024-09-19T07:07:15.072152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:29.370693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060781+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:07:15.060781+0000","last_peered":"2024-09-19T07:07:15.060781+0000","last_clean":"2024-09-19T07:07:15.060781+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:07:15.060781+0000","last_undegraded":"2024-09-19T07:07:15.060781+0000","last_fullsized":"2024-09-19T07:07:15.060781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059299+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:07:15.059299+0000","last_peered":"2024-09-19T07:07:15.059299+0000","last_clean":"2024-09-19T07:07:15.059299+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:07:15.059299+0000","last_undegraded":"2024-09-19T07:07:15.059299+0000","last_fullsized":"2024-09-19T07:07:15.059299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067493+0000","last_change":"2024-09-19T07:07:15.066954+0000","last_active":"2024-09-19T07:07:15.067493+0000","last_peered":"2024-09-19T07:07:15.067493+0000","last_clean":"2024-09-19T07:07:15.067493+0000","last_became_active":"2024-09-19T07:07:15.066612+0000","last_became_peered":"2024-09-19T07:07:15.066612+0000","last_unstale":"2024-09-19T07:07:15.067493+0000","last_undegraded":"2024-09-19T07:07:15.067493+0000","last_fullsized":"2024-09-19T07:07:15.067493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:26.150407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060948+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:07:15.060948+0000","last_peered":"2024-09-19T07:07:15.060948+0000","last_clean":"2024-09-19T07:07:15.060948+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:07:15.060948+0000","last_undegraded":"2024-09-19T07:07:15.060948+0000","last_fullsized":"2024-09-19T07:07:15.060948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064344+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:07:15.064344+0000","last_peered":"2024-09-19T07:07:15.064344+0000","last_clean":"2024-09-19T07:07:15.064344+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:07:15.064344+0000","last_undegraded":"2024-09-19T07:07:15.064344+0000","last_fullsized":"2024-09-19T07:07:15.064344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059936+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:07:15.059936+0000","last_peered":"2024-09-19T07:07:15.059936+0000","last_clean":"2024-09-19T07:07:15.059936+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:07:15.059936+0000","last_undegraded":"2024-09-19T07:07:15.059936+0000","last_fullsized":"2024-09-19T07:07:15.059936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067359+0000","last_change":"2024-09-19T07:07:15.067359+0000","last_active":"2024-09-19T07:07:15.067359+0000","last_peered":"2024-09-19T07:07:15.067359+0000","last_clean":"2024-09-19T07:07:15.067359+0000","last_became_active":"2024-09-19T07:07:15.066885+0000","last_became_peered":"2024-09-19T07:07:15.066885+0000","last_unstale":"2024-09-19T07:07:15.067359+0000","last_undegraded":"2024-09-19T07:07:15.067359+0000","last_fullsized":"2024-09-19T07:07:15.067359+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:35.148606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059417+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:07:15.059417+0000","last_peered":"2024-09-19T07:07:15.059417+0000","last_clean":"2024-09-19T07:07:15.059417+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:07:15.059417+0000","last_undegraded":"2024-09-19T07:07:15.059417+0000","last_fullsized":"2024-09-19T07:07:15.059417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086017+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:15.086017+0000","last_peered":"2024-09-19T07:07:15.086017+0000","last_clean":"2024-09-19T07:07:15.086017+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:15.086017+0000","last_undegraded":"2024-09-19T07:07:15.086017+0000","last_fullsized":"2024-09-19T07:07:15.086017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060778+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:07:15.060778+0000","last_peered":"2024-09-19T07:07:15.060778+0000","last_clean":"2024-09-19T07:07:15.060778+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:07:15.060778+0000","last_undegraded":"2024-09-19T07:07:15.060778+0000","last_fullsized":"2024-09-19T07:07:15.060778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178074+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:15.178074+0000","last_peered":"2024-09-19T07:07:15.178074+0000","last_clean":"2024-09-19T07:07:15.178074+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:15.178074+0000","last_undegraded":"2024-09-19T07:07:15.178074+0000","last_fullsized":"2024-09-19T07:07:15.178074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061553+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:07:15.061553+0000","last_peered":"2024-09-19T07:07:15.061553+0000","last_clean":"2024-09-19T07:07:15.061553+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:07:15.061553+0000","last_undegraded":"2024-09-19T07:07:15.061553+0000","last_fullsized":"2024-09-19T07:07:15.061553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060645+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:07:15.060645+0000","last_peered":"2024-09-19T07:07:15.060645+0000","last_clean":"2024-09-19T07:07:15.060645+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:07:15.060645+0000","last_undegraded":"2024-09-19T07:07:15.060645+0000","last_fullsized":"2024-09-19T07:07:15.060645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.811839+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:15.811839+0000","last_peered":"2024-09-19T07:07:15.811839+0000","last_clean":"2024-09-19T07:07:15.811839+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:15.811839+0000","last_undegraded":"2024-09-19T07:07:15.811839+0000","last_fullsized":"2024-09-19T07:07:15.811839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058971+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:07:15.058971+0000","last_peered":"2024-09-19T07:07:15.058971+0000","last_clean":"2024-09-19T07:07:15.058971+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:07:15.058971+0000","last_undegraded":"2024-09-19T07:07:15.058971+0000","last_fullsized":"2024-09-19T07:07:15.058971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057010+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:15.057010+0000","last_peered":"2024-09-19T07:07:15.057010+0000","last_clean":"2024-09-19T07:07:15.057010+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:15.057010+0000","last_undegraded":"2024-09-19T07:07:15.057010+0000","last_fullsized":"2024-09-19T07:07:15.057010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064970+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:07:15.064970+0000","last_peered":"2024-09-19T07:07:15.064970+0000","last_clean":"2024-09-19T07:07:15.064970+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:07:15.064970+0000","last_undegraded":"2024-09-19T07:07:15.064970+0000","last_fullsized":"2024-09-19T07:07:15.064970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062074+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:07:15.062074+0000","last_peered":"2024-09-19T07:07:15.062074+0000","last_clean":"2024-09-19T07:07:15.062074+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:07:15.062074+0000","last_undegraded":"2024-09-19T07:07:15.062074+0000","last_fullsized":"2024-09-19T07:07:15.062074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061661+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:07:15.061661+0000","last_peered":"2024-09-19T07:07:15.061661+0000","last_clean":"2024-09-19T07:07:15.061661+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:07:15.061661+0000","last_undegraded":"2024-09-19T07:07:15.061661+0000","last_fullsized":"2024-09-19T07:07:15.061661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060362+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:07:15.060362+0000","last_peered":"2024-09-19T07:07:15.060362+0000","last_clean":"2024-09-19T07:07:15.060362+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:07:15.060362+0000","last_undegraded":"2024-09-19T07:07:15.060362+0000","last_fullsized":"2024-09-19T07:07:15.060362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062221+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:07:15.062221+0000","last_peered":"2024-09-19T07:07:15.062221+0000","last_clean":"2024-09-19T07:07:15.062221+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:07:15.062221+0000","last_undegraded":"2024-09-19T07:07:15.062221+0000","last_fullsized":"2024-09-19T07:07:15.062221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062339+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:07:15.062339+0000","last_peered":"2024-09-19T07:07:15.062339+0000","last_clean":"2024-09-19T07:07:15.062339+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:07:15.062339+0000","last_undegraded":"2024-09-19T07:07:15.062339+0000","last_fullsized":"2024-09-19T07:07:15.062339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056887+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:15.056887+0000","last_peered":"2024-09-19T07:07:15.056887+0000","last_clean":"2024-09-19T07:07:15.056887+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:15.056887+0000","last_undegraded":"2024-09-19T07:07:15.056887+0000","last_fullsized":"2024-09-19T07:07:15.056887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057741+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:15.057741+0000","last_peered":"2024-09-19T07:07:15.057741+0000","last_clean":"2024-09-19T07:07:15.057741+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:15.057741+0000","last_undegraded":"2024-09-19T07:07:15.057741+0000","last_fullsized":"2024-09-19T07:07:15.057741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056666+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:15.056666+0000","last_peered":"2024-09-19T07:07:15.056666+0000","last_clean":"2024-09-19T07:07:15.056666+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:15.056666+0000","last_undegraded":"2024-09-19T07:07:15.056666+0000","last_fullsized":"2024-09-19T07:07:15.056666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057025+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:15.057025+0000","last_peered":"2024-09-19T07:07:15.057025+0000","last_clean":"2024-09-19T07:07:15.057025+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:15.057025+0000","last_undegraded":"2024-09-19T07:07:15.057025+0000","last_fullsized":"2024-09-19T07:07:15.057025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056535+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:15.056535+0000","last_peered":"2024-09-19T07:07:15.056535+0000","last_clean":"2024-09-19T07:07:15.056535+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.056535+0000","last_undegraded":"2024-09-19T07:07:15.056535+0000","last_fullsized":"2024-09-19T07:07:15.056535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058690+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:15.058690+0000","last_peered":"2024-09-19T07:07:15.058690+0000","last_clean":"2024-09-19T07:07:15.058690+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:15.058690+0000","last_undegraded":"2024-09-19T07:07:15.058690+0000","last_fullsized":"2024-09-19T07:07:15.058690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059640+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:07:15.059640+0000","last_peered":"2024-09-19T07:07:15.059640+0000","last_clean":"2024-09-19T07:07:15.059640+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:07:15.059640+0000","last_undegraded":"2024-09-19T07:07:15.059640+0000","last_fullsized":"2024-09-19T07:07:15.059640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061668+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:07:15.061668+0000","last_peered":"2024-09-19T07:07:15.061668+0000","last_clean":"2024-09-19T07:07:15.061668+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:07:15.061668+0000","last_undegraded":"2024-09-19T07:07:15.061668+0000","last_fullsized":"2024-09-19T07:07:15.061668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057644+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057644+0000","last_peered":"2024-09-19T07:07:15.057644+0000","last_clean":"2024-09-19T07:07:15.057644+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057644+0000","last_undegraded":"2024-09-19T07:07:15.057644+0000","last_fullsized":"2024-09-19T07:07:15.057644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086015+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:15.086015+0000","last_peered":"2024-09-19T07:07:15.086015+0000","last_clean":"2024-09-19T07:07:15.086015+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:15.086015+0000","last_undegraded":"2024-09-19T07:07:15.086015+0000","last_fullsized":"2024-09-19T07:07:15.086015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058713+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:15.058713+0000","last_peered":"2024-09-19T07:07:15.058713+0000","last_clean":"2024-09-19T07:07:15.058713+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:15.058713+0000","last_undegraded":"2024-09-19T07:07:15.058713+0000","last_fullsized":"2024-09-19T07:07:15.058713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177840+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:15.177840+0000","last_peered":"2024-09-19T07:07:15.177840+0000","last_clean":"2024-09-19T07:07:15.177840+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:15.177840+0000","last_undegraded":"2024-09-19T07:07:15.177840+0000","last_fullsized":"2024-09-19T07:07:15.177840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067483+0000","last_change":"2024-09-19T07:07:15.067483+0000","last_active":"2024-09-19T07:07:15.067483+0000","last_peered":"2024-09-19T07:07:15.067483+0000","last_clean":"2024-09-19T07:07:15.067483+0000","last_became_active":"2024-09-19T07:07:15.064076+0000","last_became_peered":"2024-09-19T07:07:15.064076+0000","last_unstale":"2024-09-19T07:07:15.067483+0000","last_undegraded":"2024-09-19T07:07:15.067483+0000","last_fullsized":"2024-09-19T07:07:15.067483+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:42.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057614+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:15.057614+0000","last_peered":"2024-09-19T07:07:15.057614+0000","last_clean":"2024-09-19T07:07:15.057614+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:15.057614+0000","last_undegraded":"2024-09-19T07:07:15.057614+0000","last_fullsized":"2024-09-19T07:07:15.057614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063452+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:07:15.063452+0000","last_peered":"2024-09-19T07:07:15.063452+0000","last_clean":"2024-09-19T07:07:15.063452+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:07:15.063452+0000","last_undegraded":"2024-09-19T07:07:15.063452+0000","last_fullsized":"2024-09-19T07:07:15.063452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.070425+0000","last_change":"2024-09-19T07:07:15.069990+0000","last_active":"2024-09-19T07:07:15.070425+0000","last_peered":"2024-09-19T07:07:15.070425+0000","last_clean":"2024-09-19T07:07:15.070425+0000","last_became_active":"2024-09-19T07:07:15.064494+0000","last_became_peered":"2024-09-19T07:07:15.064494+0000","last_unstale":"2024-09-19T07:07:15.070425+0000","last_undegraded":"2024-09-19T07:07:15.070425+0000","last_fullsized":"2024-09-19T07:07:15.070425+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:45.233325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057683+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:15.057683+0000","last_peered":"2024-09-19T07:07:15.057683+0000","last_clean":"2024-09-19T07:07:15.057683+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:15.057683+0000","last_undegraded":"2024-09-19T07:07:15.057683+0000","last_fullsized":"2024-09-19T07:07:15.057683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057775+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:15.057775+0000","last_peered":"2024-09-19T07:07:15.057775+0000","last_clean":"2024-09-19T07:07:15.057775+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:15.057775+0000","last_undegraded":"2024-09-19T07:07:15.057775+0000","last_fullsized":"2024-09-19T07:07:15.057775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062951+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:07:15.062951+0000","last_peered":"2024-09-19T07:07:15.062951+0000","last_clean":"2024-09-19T07:07:15.062951+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:07:15.062951+0000","last_undegraded":"2024-09-19T07:07:15.062951+0000","last_fullsized":"2024-09-19T07:07:15.062951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057175+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:15.057175+0000","last_peered":"2024-09-19T07:07:15.057175+0000","last_clean":"2024-09-19T07:07:15.057175+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:15.057175+0000","last_undegraded":"2024-09-19T07:07:15.057175+0000","last_fullsized":"2024-09-19T07:07:15.057175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060703+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:07:15.060703+0000","last_peered":"2024-09-19T07:07:15.060703+0000","last_clean":"2024-09-19T07:07:15.060703+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:07:15.060703+0000","last_undegraded":"2024-09-19T07:07:15.060703+0000","last_fullsized":"2024-09-19T07:07:15.060703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061227+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:07:15.061227+0000","last_peered":"2024-09-19T07:07:15.061227+0000","last_clean":"2024-09-19T07:07:15.061227+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:07:15.061227+0000","last_undegraded":"2024-09-19T07:07:15.061227+0000","last_fullsized":"2024-09-19T07:07:15.061227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057997+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:15.057997+0000","last_peered":"2024-09-19T07:07:15.057997+0000","last_clean":"2024-09-19T07:07:15.057997+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:15.057997+0000","last_undegraded":"2024-09-19T07:07:15.057997+0000","last_fullsized":"2024-09-19T07:07:15.057997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062190+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:07:15.062190+0000","last_peered":"2024-09-19T07:07:15.062190+0000","last_clean":"2024-09-19T07:07:15.062190+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:07:15.062190+0000","last_undegraded":"2024-09-19T07:07:15.062190+0000","last_fullsized":"2024-09-19T07:07:15.062190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056695+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:15.056695+0000","last_peered":"2024-09-19T07:07:15.056695+0000","last_clean":"2024-09-19T07:07:15.056695+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:15.056695+0000","last_undegraded":"2024-09-19T07:07:15.056695+0000","last_fullsized":"2024-09-19T07:07:15.056695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058263+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:15.058263+0000","last_peered":"2024-09-19T07:07:15.058263+0000","last_clean":"2024-09-19T07:07:15.058263+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:15.058263+0000","last_undegraded":"2024-09-19T07:07:15.058263+0000","last_fullsized":"2024-09-19T07:07:15.058263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064712+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:07:15.064712+0000","last_peered":"2024-09-19T07:07:15.064712+0000","last_clean":"2024-09-19T07:07:15.064712+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:07:15.064712+0000","last_undegraded":"2024-09-19T07:07:15.064712+0000","last_fullsized":"2024-09-19T07:07:15.064712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'30","reported_seq":204,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:08:06.115301+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:08:06.115301+0000","last_peered":"2024-09-19T07:08:06.115301+0000","last_clean":"2024-09-19T07:08:06.115301+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:08:06.115301+0000","last_undegraded":"2024-09-19T07:08:06.115301+0000","last_fullsized":"2024-09-19T07:08:06.115301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060105+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:07:15.060105+0000","last_peered":"2024-09-19T07:07:15.060105+0000","last_clean":"2024-09-19T07:07:15.060105+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:07:15.060105+0000","last_undegraded":"2024-09-19T07:07:15.060105+0000","last_fullsized":"2024-09-19T07:07:15.060105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086241+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:15.086241+0000","last_peered":"2024-09-19T07:07:15.086241+0000","last_clean":"2024-09-19T07:07:15.086241+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.086241+0000","last_undegraded":"2024-09-19T07:07:15.086241+0000","last_fullsized":"2024-09-19T07:07:15.086241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058608+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:15.058608+0000","last_peered":"2024-09-19T07:07:15.058608+0000","last_clean":"2024-09-19T07:07:15.058608+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:15.058608+0000","last_undegraded":"2024-09-19T07:07:15.058608+0000","last_fullsized":"2024-09-19T07:07:15.058608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061390+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:07:15.061390+0000","last_peered":"2024-09-19T07:07:15.061390+0000","last_clean":"2024-09-19T07:07:15.061390+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:07:15.061390+0000","last_undegraded":"2024-09-19T07:07:15.061390+0000","last_fullsized":"2024-09-19T07:07:15.061390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178243+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:15.178243+0000","last_peered":"2024-09-19T07:07:15.178243+0000","last_clean":"2024-09-19T07:07:15.178243+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:15.178243+0000","last_undegraded":"2024-09-19T07:07:15.178243+0000","last_fullsized":"2024-09-19T07:07:15.178243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059369+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:07:15.059369+0000","last_peered":"2024-09-19T07:07:15.059369+0000","last_clean":"2024-09-19T07:07:15.059369+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:07:15.059369+0000","last_undegraded":"2024-09-19T07:07:15.059369+0000","last_fullsized":"2024-09-19T07:07:15.059369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086511+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:15.086511+0000","last_peered":"2024-09-19T07:07:15.086511+0000","last_clean":"2024-09-19T07:07:15.086511+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:15.086511+0000","last_undegraded":"2024-09-19T07:07:15.086511+0000","last_fullsized":"2024-09-19T07:07:15.086511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062233+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:07:15.062233+0000","last_peered":"2024-09-19T07:07:15.062233+0000","last_clean":"2024-09-19T07:07:15.062233+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:07:15.062233+0000","last_undegraded":"2024-09-19T07:07:15.062233+0000","last_fullsized":"2024-09-19T07:07:15.062233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059669+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:07:15.059669+0000","last_peered":"2024-09-19T07:07:15.059669+0000","last_clean":"2024-09-19T07:07:15.059669+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:07:15.059669+0000","last_undegraded":"2024-09-19T07:07:15.059669+0000","last_fullsized":"2024-09-19T07:07:15.059669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177946+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:15.177946+0000","last_peered":"2024-09-19T07:07:15.177946+0000","last_clean":"2024-09-19T07:07:15.177946+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:15.177946+0000","last_undegraded":"2024-09-19T07:07:15.177946+0000","last_fullsized":"2024-09-19T07:07:15.177946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059855+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:07:15.059855+0000","last_peered":"2024-09-19T07:07:15.059855+0000","last_clean":"2024-09-19T07:07:15.059855+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:07:15.059855+0000","last_undegraded":"2024-09-19T07:07:15.059855+0000","last_fullsized":"2024-09-19T07:07:15.059855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057987+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:15.057987+0000","last_peered":"2024-09-19T07:07:15.057987+0000","last_clean":"2024-09-19T07:07:15.057987+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:15.057987+0000","last_undegraded":"2024-09-19T07:07:15.057987+0000","last_fullsized":"2024-09-19T07:07:15.057987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179142+0000","last_change":"2024-09-19T07:07:15.179142+0000","last_active":"2024-09-19T07:07:15.179142+0000","last_peered":"2024-09-19T07:07:15.179142+0000","last_clean":"2024-09-19T07:07:15.179142+0000","last_became_active":"2024-09-19T07:07:15.178586+0000","last_became_peered":"2024-09-19T07:07:15.178586+0000","last_unstale":"2024-09-19T07:07:15.179142+0000","last_undegraded":"2024-09-19T07:07:15.179142+0000","last_fullsized":"2024-09-19T07:07:15.179142+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:24.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059113+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:07:15.059113+0000","last_peered":"2024-09-19T07:07:15.059113+0000","last_clean":"2024-09-19T07:07:15.059113+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:07:15.059113+0000","last_undegraded":"2024-09-19T07:07:15.059113+0000","last_fullsized":"2024-09-19T07:07:15.059113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056560+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:15.056560+0000","last_peered":"2024-09-19T07:07:15.056560+0000","last_clean":"2024-09-19T07:07:15.056560+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:15.056560+0000","last_undegraded":"2024-09-19T07:07:15.056560+0000","last_fullsized":"2024-09-19T07:07:15.056560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061522+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:07:15.061522+0000","last_peered":"2024-09-19T07:07:15.061522+0000","last_clean":"2024-09-19T07:07:15.061522+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:07:15.061522+0000","last_undegraded":"2024-09-19T07:07:15.061522+0000","last_fullsized":"2024-09-19T07:07:15.061522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058324+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:15.058324+0000","last_peered":"2024-09-19T07:07:15.058324+0000","last_clean":"2024-09-19T07:07:15.058324+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:15.058324+0000","last_undegraded":"2024-09-19T07:07:15.058324+0000","last_fullsized":"2024-09-19T07:07:15.058324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058457+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:15.058457+0000","last_peered":"2024-09-19T07:07:15.058457+0000","last_clean":"2024-09-19T07:07:15.058457+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:15.058457+0000","last_undegraded":"2024-09-19T07:07:15.058457+0000","last_fullsized":"2024-09-19T07:07:15.058457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062435+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:07:15.062435+0000","last_peered":"2024-09-19T07:07:15.062435+0000","last_clean":"2024-09-19T07:07:15.062435+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:07:15.062435+0000","last_undegraded":"2024-09-19T07:07:15.062435+0000","last_fullsized":"2024-09-19T07:07:15.062435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064296+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:07:15.064296+0000","last_peered":"2024-09-19T07:07:15.064296+0000","last_clean":"2024-09-19T07:07:15.064296+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:07:15.064296+0000","last_undegraded":"2024-09-19T07:07:15.064296+0000","last_fullsized":"2024-09-19T07:07:15.064296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177982+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:15.177982+0000","last_peered":"2024-09-19T07:07:15.177982+0000","last_clean":"2024-09-19T07:07:15.177982+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:15.177982+0000","last_undegraded":"2024-09-19T07:07:15.177982+0000","last_fullsized":"2024-09-19T07:07:15.177982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057006+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:15.057006+0000","last_peered":"2024-09-19T07:07:15.057006+0000","last_clean":"2024-09-19T07:07:15.057006+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:15.057006+0000","last_undegraded":"2024-09-19T07:07:15.057006+0000","last_fullsized":"2024-09-19T07:07:15.057006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063399+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:07:15.063399+0000","last_peered":"2024-09-19T07:07:15.063399+0000","last_clean":"2024-09-19T07:07:15.063399+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:07:15.063399+0000","last_undegraded":"2024-09-19T07:07:15.063399+0000","last_fullsized":"2024-09-19T07:07:15.063399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057769+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:15.057769+0000","last_peered":"2024-09-19T07:07:15.057769+0000","last_clean":"2024-09-19T07:07:15.057769+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:15.057769+0000","last_undegraded":"2024-09-19T07:07:15.057769+0000","last_fullsized":"2024-09-19T07:07:15.057769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059836+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:07:15.059836+0000","last_peered":"2024-09-19T07:07:15.059836+0000","last_clean":"2024-09-19T07:07:15.059836+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:07:15.059836+0000","last_undegraded":"2024-09-19T07:07:15.059836+0000","last_fullsized":"2024-09-19T07:07:15.059836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086193+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:15.086193+0000","last_peered":"2024-09-19T07:07:15.086193+0000","last_clean":"2024-09-19T07:07:15.086193+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:15.086193+0000","last_undegraded":"2024-09-19T07:07:15.086193+0000","last_fullsized":"2024-09-19T07:07:15.086193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056901+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:15.056901+0000","last_peered":"2024-09-19T07:07:15.056901+0000","last_clean":"2024-09-19T07:07:15.056901+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:15.056901+0000","last_undegraded":"2024-09-19T07:07:15.056901+0000","last_fullsized":"2024-09-19T07:07:15.056901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061870+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:07:15.061870+0000","last_peered":"2024-09-19T07:07:15.061870+0000","last_clean":"2024-09-19T07:07:15.061870+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:07:15.061870+0000","last_undegraded":"2024-09-19T07:07:15.061870+0000","last_fullsized":"2024-09-19T07:07:15.061870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060878+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:07:15.060878+0000","last_peered":"2024-09-19T07:07:15.060878+0000","last_clean":"2024-09-19T07:07:15.060878+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:07:15.060878+0000","last_undegraded":"2024-09-19T07:07:15.060878+0000","last_fullsized":"2024-09-19T07:07:15.060878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063278+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:07:15.063278+0000","last_peered":"2024-09-19T07:07:15.063278+0000","last_clean":"2024-09-19T07:07:15.063278+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:07:15.063278+0000","last_undegraded":"2024-09-19T07:07:15.063278+0000","last_fullsized":"2024-09-19T07:07:15.063278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.085854+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:15.085854+0000","last_peered":"2024-09-19T07:07:15.085854+0000","last_clean":"2024-09-19T07:07:15.085854+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:15.085854+0000","last_undegraded":"2024-09-19T07:07:15.085854+0000","last_fullsized":"2024-09-19T07:07:15.085854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177830+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:15.177830+0000","last_peered":"2024-09-19T07:07:15.177830+0000","last_clean":"2024-09-19T07:07:15.177830+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:15.177830+0000","last_undegraded":"2024-09-19T07:07:15.177830+0000","last_fullsized":"2024-09-19T07:07:15.177830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177571+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:15.177571+0000","last_peered":"2024-09-19T07:07:15.177571+0000","last_clean":"2024-09-19T07:07:15.177571+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:15.177571+0000","last_undegraded":"2024-09-19T07:07:15.177571+0000","last_fullsized":"2024-09-19T07:07:15.177571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056875+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:15.056875+0000","last_peered":"2024-09-19T07:07:15.056875+0000","last_clean":"2024-09-19T07:07:15.056875+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:15.056875+0000","last_undegraded":"2024-09-19T07:07:15.056875+0000","last_fullsized":"2024-09-19T07:07:15.056875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061384+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:07:15.061384+0000","last_peered":"2024-09-19T07:07:15.061384+0000","last_clean":"2024-09-19T07:07:15.061384+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:07:15.061384+0000","last_undegraded":"2024-09-19T07:07:15.061384+0000","last_fullsized":"2024-09-19T07:07:15.061384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067182+0000","last_change":"2024-09-19T07:07:15.067182+0000","last_active":"2024-09-19T07:07:15.067182+0000","last_peered":"2024-09-19T07:07:15.067182+0000","last_clean":"2024-09-19T07:07:15.067182+0000","last_became_active":"2024-09-19T07:07:15.066805+0000","last_became_peered":"2024-09-19T07:07:15.066805+0000","last_unstale":"2024-09-19T07:07:15.067182+0000","last_undegraded":"2024-09-19T07:07:15.067182+0000","last_fullsized":"2024-09-19T07:07:15.067182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:05.606025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086686+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:15.086686+0000","last_peered":"2024-09-19T07:07:15.086686+0000","last_clean":"2024-09-19T07:07:15.086686+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:15.086686+0000","last_undegraded":"2024-09-19T07:07:15.086686+0000","last_fullsized":"2024-09-19T07:07:15.086686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059089+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:07:15.059089+0000","last_peered":"2024-09-19T07:07:15.059089+0000","last_clean":"2024-09-19T07:07:15.059089+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:07:15.059089+0000","last_undegraded":"2024-09-19T07:07:15.059089+0000","last_fullsized":"2024-09-19T07:07:15.059089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061406+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:07:15.061406+0000","last_peered":"2024-09-19T07:07:15.061406+0000","last_clean":"2024-09-19T07:07:15.061406+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:07:15.061406+0000","last_undegraded":"2024-09-19T07:07:15.061406+0000","last_fullsized":"2024-09-19T07:07:15.061406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064389+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:07:15.064389+0000","last_peered":"2024-09-19T07:07:15.064389+0000","last_clean":"2024-09-19T07:07:15.064389+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:07:15.064389+0000","last_undegraded":"2024-09-19T07:07:15.064389+0000","last_fullsized":"2024-09-19T07:07:15.064389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061304+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:07:15.061304+0000","last_peered":"2024-09-19T07:07:15.061304+0000","last_clean":"2024-09-19T07:07:15.061304+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:07:15.061304+0000","last_undegraded":"2024-09-19T07:07:15.061304+0000","last_fullsized":"2024-09-19T07:07:15.061304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177882+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:15.177882+0000","last_peered":"2024-09-19T07:07:15.177882+0000","last_clean":"2024-09-19T07:07:15.177882+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:15.177882+0000","last_undegraded":"2024-09-19T07:07:15.177882+0000","last_fullsized":"2024-09-19T07:07:15.177882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178041+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:15.178041+0000","last_peered":"2024-09-19T07:07:15.178041+0000","last_clean":"2024-09-19T07:07:15.178041+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:15.178041+0000","last_undegraded":"2024-09-19T07:07:15.178041+0000","last_fullsized":"2024-09-19T07:07:15.178041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062462+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:07:15.062462+0000","last_peered":"2024-09-19T07:07:15.062462+0000","last_clean":"2024-09-19T07:07:15.062462+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:07:15.062462+0000","last_undegraded":"2024-09-19T07:07:15.062462+0000","last_fullsized":"2024-09-19T07:07:15.062462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":85,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514530,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1154600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1024000,"data_stored":509301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":504623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561083,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1622016,"data_stored":1095173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":500631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":564072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":564620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1015808,"data_stored":500617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:08:10.507 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:08:10.769 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:10.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:10 smithi029 ceph-mon[31255]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:08:10.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:10 smithi078 ceph-mon[34556]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:08:10.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:10 smithi046 ceph-mon[34147]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:08:11.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.239+0000 7fa7545f3640 1 -- 172.21.15.29:0/419915482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 msgr2=0x7fa74c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:11.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.239+0000 7fa7545f3640 1 --2- 172.21.15.29:0/419915482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c10e610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa744009ca0 tx=0x7fa74402a950 comp rx=0 tx=0).stop 2024-09-19T07:08:11.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 -- 172.21.15.29:0/419915482 shutdown_connections 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 --2- 172.21.15.29:0/419915482 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c10e610 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 --2- 172.21.15.29:0/419915482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa74c103660 0x7fa74c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 --2- 172.21.15.29:0/419915482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c102d40 0x7fa74c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 -- 172.21.15.29:0/419915482 >> 172.21.15.29:0/419915482 conn(0x7fa74c0fc7a0 msgr2=0x7fa74c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 -- 172.21.15.29:0/419915482 shutdown_connections 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 -- 172.21.15.29:0/419915482 wait complete. 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 Processor -- start 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.240+0000 7fa7545f3640 1 -- start start 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa7545f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa74c102d40 0x7fa74c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa7545f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c103660 0x7fa74c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa7545f3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:11.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa7545f3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c111e20 con 0x7fa74c10c170 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa7545f3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c111ca0 con 0x7fa74c102d40 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa7545f3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c111fa0 con 0x7fa74c103660 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39254/0 (socket says 172.21.15.29:39254) 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 -- 172.21.15.29:0/629784084 learned_addr learned my addr 172.21.15.29:0/629784084 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa75238f640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa74c102d40 0x7fa74c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa751b8e640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c103660 0x7fa74c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 -- 172.21.15.29:0/629784084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c103660 msgr2=0x7fa74c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c103660 0x7fa74c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 -- 172.21.15.29:0/629784084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa74c102d40 msgr2=0x7fa74c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa74c102d40 0x7fa74c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 -- 172.21.15.29:0/629784084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c1a6800 con 0x7fa74c10c170 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.241+0000 7fa752b90640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c101420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa74402ae70 tx=0x7fa74402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:11.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.242+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744034040 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.242+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7440308f0 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.242+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c1a6a90 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.242+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440047f0 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.242+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c1a6fc0 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.243+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c103120 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.244+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa744037020 con 0x7fa74c10c170 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.244+0000 7fa7437fe640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7380a3350 0x7fa7380a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.245+0000 7fa75238f640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7380a3350 0x7fa7380a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:11.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.245+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fa7440f0bb0 con 0x7fa74c10c170 2024-09-19T07:08:11.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.245+0000 7fa75238f640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7380a3350 0x7fa7380a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa748005fd0 tx=0x7fa74800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:11.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.249+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7440bd520 con 0x7fa74c10c170 2024-09-19T07:08:11.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.420+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa74c062630 con 0x7fa7380a3350 2024-09-19T07:08:11.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.430+0000 7fa7437fe640 1 -- 172.21.15.29:0/629784084 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340289 (secure 0 0 0) 0x7fa74c062630 con 0x7fa7380a3350 2024-09-19T07:08:11.435 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:11.437 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-19T07:08:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.433+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7380a3350 msgr2=0x7fa7380a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.433+0000 7fa7545f3640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7380a3350 0x7fa7380a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa748005fd0 tx=0x7fa74800b390 comp rx=0 tx=0).stop 2024-09-19T07:08:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.433+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 msgr2=0x7fa74c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.433+0000 7fa7545f3640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c101420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa74402ae70 tx=0x7fa74402f5d0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 shutdown_connections 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa74c10c170 0x7fa74c101420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fa7380a3350 0x7fa7380a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa74c103660 0x7fa74c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 --2- 172.21.15.29:0/629784084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa74c102d40 0x7fa74c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 >> 172.21.15.29:0/629784084 conn(0x7fa74c0fc7a0 msgr2=0x7fa74c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 shutdown_connections 2024-09-19T07:08:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:11.434+0000 7fa7545f3640 1 -- 172.21.15.29:0/629784084 wait complete. 2024-09-19T07:08:11.810 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:11 smithi029 ceph-mon[31255]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:11.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:11 smithi078 ceph-mon[34556]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:11 smithi046 ceph-mon[34147]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:12.314 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-19T07:08:09.869083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654911,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":271,"num_read_kb":246,"num_write":268,"num_write_kb":3032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181340,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":404816,"kb_used_data":13904,"kb_used_omap":18,"kb_used_meta":390637,"kb_avail":1124537008,"statfs":{"total":1151940427776,"available":1151525896192,"internally_reserved":0,"allocated":14237696,"data_stored":8003123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":400012604},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003541"},"pg_stats":[{"pgid":"2.1f","version":"82'4","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.091196+0000","last_change":"2024-09-19T07:07:15.091196+0000","last_active":"2024-09-19T07:07:15.091196+0000","last_peered":"2024-09-19T07:07:15.091196+0000","last_clean":"2024-09-19T07:07:15.091196+0000","last_became_active":"2024-09-19T07:07:15.087619+0000","last_became_peered":"2024-09-19T07:07:15.087619+0000","last_unstale":"2024-09-19T07:07:15.091196+0000","last_undegraded":"2024-09-19T07:07:15.091196+0000","last_fullsized":"2024-09-19T07:07:15.091196+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:01.778892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059328+0000","last_change":"2024-09-19T07:06:24.786393+0000","last_active":"2024-09-19T07:07:15.059328+0000","last_peered":"2024-09-19T07:07:15.059328+0000","last_clean":"2024-09-19T07:07:15.059328+0000","last_became_active":"2024-09-19T07:06:24.786105+0000","last_became_peered":"2024-09-19T07:06:24.786105+0000","last_unstale":"2024-09-19T07:07:15.059328+0000","last_undegraded":"2024-09-19T07:07:15.059328+0000","last_fullsized":"2024-09-19T07:07:15.059328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:23.947129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179333+0000","last_change":"2024-09-19T07:07:15.179333+0000","last_active":"2024-09-19T07:07:15.179333+0000","last_peered":"2024-09-19T07:07:15.179333+0000","last_clean":"2024-09-19T07:07:15.179333+0000","last_became_active":"2024-09-19T07:07:15.178780+0000","last_became_peered":"2024-09-19T07:07:15.178780+0000","last_unstale":"2024-09-19T07:07:15.179333+0000","last_undegraded":"2024-09-19T07:07:15.179333+0000","last_fullsized":"2024-09-19T07:07:15.179333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:58.486186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059519+0000","last_change":"2024-09-19T07:06:22.753197+0000","last_active":"2024-09-19T07:07:15.059519+0000","last_peered":"2024-09-19T07:07:15.059519+0000","last_clean":"2024-09-19T07:07:15.059519+0000","last_became_active":"2024-09-19T07:06:22.752836+0000","last_became_peered":"2024-09-19T07:06:22.752836+0000","last_unstale":"2024-09-19T07:07:15.059519+0000","last_undegraded":"2024-09-19T07:07:15.059519+0000","last_fullsized":"2024-09-19T07:07:15.059519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:17.316996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178223+0000","last_change":"2024-09-19T07:06:24.773307+0000","last_active":"2024-09-19T07:07:15.178223+0000","last_peered":"2024-09-19T07:07:15.178223+0000","last_clean":"2024-09-19T07:07:15.178223+0000","last_became_active":"2024-09-19T07:06:24.773008+0000","last_became_peered":"2024-09-19T07:06:24.773008+0000","last_unstale":"2024-09-19T07:07:15.178223+0000","last_undegraded":"2024-09-19T07:07:15.178223+0000","last_fullsized":"2024-09-19T07:07:15.178223+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:51:14.961499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060171+0000","last_change":"2024-09-19T07:06:31.840258+0000","last_active":"2024-09-19T07:07:15.060171+0000","last_peered":"2024-09-19T07:07:15.060171+0000","last_clean":"2024-09-19T07:07:15.060171+0000","last_became_active":"2024-09-19T07:06:31.839852+0000","last_became_peered":"2024-09-19T07:06:31.839852+0000","last_unstale":"2024-09-19T07:07:15.060171+0000","last_undegraded":"2024-09-19T07:07:15.060171+0000","last_fullsized":"2024-09-19T07:07:15.060171+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:33.241369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064869+0000","last_change":"2024-09-19T07:06:22.668168+0000","last_active":"2024-09-19T07:07:15.064869+0000","last_peered":"2024-09-19T07:07:15.064869+0000","last_clean":"2024-09-19T07:07:15.064869+0000","last_became_active":"2024-09-19T07:06:22.667452+0000","last_became_peered":"2024-09-19T07:06:22.667452+0000","last_unstale":"2024-09-19T07:07:15.064869+0000","last_undegraded":"2024-09-19T07:07:15.064869+0000","last_fullsized":"2024-09-19T07:07:15.064869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:12.801736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086202+0000","last_change":"2024-09-19T07:06:24.790923+0000","last_active":"2024-09-19T07:07:15.086202+0000","last_peered":"2024-09-19T07:07:15.086202+0000","last_clean":"2024-09-19T07:07:15.086202+0000","last_became_active":"2024-09-19T07:06:24.790603+0000","last_became_peered":"2024-09-19T07:06:24.790603+0000","last_unstale":"2024-09-19T07:07:15.086202+0000","last_undegraded":"2024-09-19T07:07:15.086202+0000","last_fullsized":"2024-09-19T07:07:15.086202+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:45.527374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064418+0000","last_change":"2024-09-19T07:07:15.064418+0000","last_active":"2024-09-19T07:07:15.064418+0000","last_peered":"2024-09-19T07:07:15.064418+0000","last_clean":"2024-09-19T07:07:15.064418+0000","last_became_active":"2024-09-19T07:07:15.063859+0000","last_became_peered":"2024-09-19T07:07:15.063859+0000","last_unstale":"2024-09-19T07:07:15.064418+0000","last_undegraded":"2024-09-19T07:07:15.064418+0000","last_fullsized":"2024-09-19T07:07:15.064418+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:22.219231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,10,5],"acting":[4,3,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.065231+0000","last_change":"2024-09-19T07:06:22.662865+0000","last_active":"2024-09-19T07:07:15.065231+0000","last_peered":"2024-09-19T07:07:15.065231+0000","last_clean":"2024-09-19T07:07:15.065231+0000","last_became_active":"2024-09-19T07:06:22.662523+0000","last_became_peered":"2024-09-19T07:06:22.662523+0000","last_unstale":"2024-09-19T07:07:15.065231+0000","last_undegraded":"2024-09-19T07:07:15.065231+0000","last_fullsized":"2024-09-19T07:07:15.065231+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:03.212038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058483+0000","last_change":"2024-09-19T07:06:24.781270+0000","last_active":"2024-09-19T07:07:15.058483+0000","last_peered":"2024-09-19T07:07:15.058483+0000","last_clean":"2024-09-19T07:07:15.058483+0000","last_became_active":"2024-09-19T07:06:24.780399+0000","last_became_peered":"2024-09-19T07:06:24.780399+0000","last_unstale":"2024-09-19T07:07:15.058483+0000","last_undegraded":"2024-09-19T07:07:15.058483+0000","last_fullsized":"2024-09-19T07:07:15.058483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:26:40.032564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060553+0000","last_change":"2024-09-19T07:06:31.842829+0000","last_active":"2024-09-19T07:07:15.060553+0000","last_peered":"2024-09-19T07:07:15.060553+0000","last_clean":"2024-09-19T07:07:15.060553+0000","last_became_active":"2024-09-19T07:06:31.842427+0000","last_became_peered":"2024-09-19T07:06:31.842427+0000","last_unstale":"2024-09-19T07:07:15.060553+0000","last_undegraded":"2024-09-19T07:07:15.060553+0000","last_fullsized":"2024-09-19T07:07:15.060553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:27.722464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057582+0000","last_change":"2024-09-19T07:06:24.790373+0000","last_active":"2024-09-19T07:07:15.057582+0000","last_peered":"2024-09-19T07:07:15.057582+0000","last_clean":"2024-09-19T07:07:15.057582+0000","last_became_active":"2024-09-19T07:06:24.789682+0000","last_became_peered":"2024-09-19T07:06:24.789682+0000","last_unstale":"2024-09-19T07:07:15.057582+0000","last_undegraded":"2024-09-19T07:07:15.057582+0000","last_fullsized":"2024-09-19T07:07:15.057582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:40.118844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.072152+0000","last_change":"2024-09-19T07:07:15.072152+0000","last_active":"2024-09-19T07:07:15.072152+0000","last_peered":"2024-09-19T07:07:15.072152+0000","last_clean":"2024-09-19T07:07:15.072152+0000","last_became_active":"2024-09-19T07:07:15.066108+0000","last_became_peered":"2024-09-19T07:07:15.066108+0000","last_unstale":"2024-09-19T07:07:15.072152+0000","last_undegraded":"2024-09-19T07:07:15.072152+0000","last_fullsized":"2024-09-19T07:07:15.072152+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:29.370693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060781+0000","last_change":"2024-09-19T07:06:31.838677+0000","last_active":"2024-09-19T07:07:15.060781+0000","last_peered":"2024-09-19T07:07:15.060781+0000","last_clean":"2024-09-19T07:07:15.060781+0000","last_became_active":"2024-09-19T07:06:31.838108+0000","last_became_peered":"2024-09-19T07:06:31.838108+0000","last_unstale":"2024-09-19T07:07:15.060781+0000","last_undegraded":"2024-09-19T07:07:15.060781+0000","last_fullsized":"2024-09-19T07:07:15.060781+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:07.655480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059299+0000","last_change":"2024-09-19T07:06:24.784133+0000","last_active":"2024-09-19T07:07:15.059299+0000","last_peered":"2024-09-19T07:07:15.059299+0000","last_clean":"2024-09-19T07:07:15.059299+0000","last_became_active":"2024-09-19T07:06:24.783789+0000","last_became_peered":"2024-09-19T07:06:24.783789+0000","last_unstale":"2024-09-19T07:07:15.059299+0000","last_undegraded":"2024-09-19T07:07:15.059299+0000","last_fullsized":"2024-09-19T07:07:15.059299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:05.141761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067493+0000","last_change":"2024-09-19T07:07:15.066954+0000","last_active":"2024-09-19T07:07:15.067493+0000","last_peered":"2024-09-19T07:07:15.067493+0000","last_clean":"2024-09-19T07:07:15.067493+0000","last_became_active":"2024-09-19T07:07:15.066612+0000","last_became_peered":"2024-09-19T07:07:15.066612+0000","last_unstale":"2024-09-19T07:07:15.067493+0000","last_undegraded":"2024-09-19T07:07:15.067493+0000","last_fullsized":"2024-09-19T07:07:15.067493+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:26.150407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060948+0000","last_change":"2024-09-19T07:06:31.840437+0000","last_active":"2024-09-19T07:07:15.060948+0000","last_peered":"2024-09-19T07:07:15.060948+0000","last_clean":"2024-09-19T07:07:15.060948+0000","last_became_active":"2024-09-19T07:06:31.839981+0000","last_became_peered":"2024-09-19T07:06:31.839981+0000","last_unstale":"2024-09-19T07:07:15.060948+0000","last_undegraded":"2024-09-19T07:07:15.060948+0000","last_fullsized":"2024-09-19T07:07:15.060948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:23:15.055725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064344+0000","last_change":"2024-09-19T07:06:24.773035+0000","last_active":"2024-09-19T07:07:15.064344+0000","last_peered":"2024-09-19T07:07:15.064344+0000","last_clean":"2024-09-19T07:07:15.064344+0000","last_became_active":"2024-09-19T07:06:24.772422+0000","last_became_peered":"2024-09-19T07:06:24.772422+0000","last_unstale":"2024-09-19T07:07:15.064344+0000","last_undegraded":"2024-09-19T07:07:15.064344+0000","last_fullsized":"2024-09-19T07:07:15.064344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:32.579161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059936+0000","last_change":"2024-09-19T07:06:22.659670+0000","last_active":"2024-09-19T07:07:15.059936+0000","last_peered":"2024-09-19T07:07:15.059936+0000","last_clean":"2024-09-19T07:07:15.059936+0000","last_became_active":"2024-09-19T07:06:22.659310+0000","last_became_peered":"2024-09-19T07:06:22.659310+0000","last_unstale":"2024-09-19T07:07:15.059936+0000","last_undegraded":"2024-09-19T07:07:15.059936+0000","last_fullsized":"2024-09-19T07:07:15.059936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:56.496850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067359+0000","last_change":"2024-09-19T07:07:15.067359+0000","last_active":"2024-09-19T07:07:15.067359+0000","last_peered":"2024-09-19T07:07:15.067359+0000","last_clean":"2024-09-19T07:07:15.067359+0000","last_became_active":"2024-09-19T07:07:15.066885+0000","last_became_peered":"2024-09-19T07:07:15.066885+0000","last_unstale":"2024-09-19T07:07:15.067359+0000","last_undegraded":"2024-09-19T07:07:15.067359+0000","last_fullsized":"2024-09-19T07:07:15.067359+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:35.148606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,8],"acting":[9,3,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059417+0000","last_change":"2024-09-19T07:06:24.776594+0000","last_active":"2024-09-19T07:07:15.059417+0000","last_peered":"2024-09-19T07:07:15.059417+0000","last_clean":"2024-09-19T07:07:15.059417+0000","last_became_active":"2024-09-19T07:06:24.776248+0000","last_became_peered":"2024-09-19T07:06:24.776248+0000","last_unstale":"2024-09-19T07:07:15.059417+0000","last_undegraded":"2024-09-19T07:07:15.059417+0000","last_fullsized":"2024-09-19T07:07:15.059417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:12:03.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086017+0000","last_change":"2024-09-19T07:06:22.754902+0000","last_active":"2024-09-19T07:07:15.086017+0000","last_peered":"2024-09-19T07:07:15.086017+0000","last_clean":"2024-09-19T07:07:15.086017+0000","last_became_active":"2024-09-19T07:06:22.754511+0000","last_became_peered":"2024-09-19T07:06:22.754511+0000","last_unstale":"2024-09-19T07:07:15.086017+0000","last_undegraded":"2024-09-19T07:07:15.086017+0000","last_fullsized":"2024-09-19T07:07:15.086017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:15.779726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060778+0000","last_change":"2024-09-19T07:06:31.837032+0000","last_active":"2024-09-19T07:07:15.060778+0000","last_peered":"2024-09-19T07:07:15.060778+0000","last_clean":"2024-09-19T07:07:15.060778+0000","last_became_active":"2024-09-19T07:06:31.836560+0000","last_became_peered":"2024-09-19T07:06:31.836560+0000","last_unstale":"2024-09-19T07:07:15.060778+0000","last_undegraded":"2024-09-19T07:07:15.060778+0000","last_fullsized":"2024-09-19T07:07:15.060778+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:45.389799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178074+0000","last_change":"2024-09-19T07:06:24.787330+0000","last_active":"2024-09-19T07:07:15.178074+0000","last_peered":"2024-09-19T07:07:15.178074+0000","last_clean":"2024-09-19T07:07:15.178074+0000","last_became_active":"2024-09-19T07:06:24.787030+0000","last_became_peered":"2024-09-19T07:06:24.787030+0000","last_unstale":"2024-09-19T07:07:15.178074+0000","last_undegraded":"2024-09-19T07:07:15.178074+0000","last_fullsized":"2024-09-19T07:07:15.178074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:06.401216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"82'2","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061553+0000","last_change":"2024-09-19T07:06:22.704356+0000","last_active":"2024-09-19T07:07:15.061553+0000","last_peered":"2024-09-19T07:07:15.061553+0000","last_clean":"2024-09-19T07:07:15.061553+0000","last_became_active":"2024-09-19T07:06:22.704012+0000","last_became_peered":"2024-09-19T07:06:22.704012+0000","last_unstale":"2024-09-19T07:07:15.061553+0000","last_undegraded":"2024-09-19T07:07:15.061553+0000","last_fullsized":"2024-09-19T07:07:15.061553+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:26.235557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060051+0000","last_change":"2024-09-19T07:06:31.834104+0000","last_active":"2024-09-19T07:07:15.060051+0000","last_peered":"2024-09-19T07:07:15.060051+0000","last_clean":"2024-09-19T07:07:15.060051+0000","last_became_active":"2024-09-19T07:06:31.833649+0000","last_became_peered":"2024-09-19T07:06:31.833649+0000","last_unstale":"2024-09-19T07:07:15.060051+0000","last_undegraded":"2024-09-19T07:07:15.060051+0000","last_fullsized":"2024-09-19T07:07:15.060051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:52.499927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060645+0000","last_change":"2024-09-19T07:06:24.785652+0000","last_active":"2024-09-19T07:07:15.060645+0000","last_peered":"2024-09-19T07:07:15.060645+0000","last_clean":"2024-09-19T07:07:15.060645+0000","last_became_active":"2024-09-19T07:06:24.785321+0000","last_became_peered":"2024-09-19T07:06:24.785321+0000","last_unstale":"2024-09-19T07:07:15.060645+0000","last_undegraded":"2024-09-19T07:07:15.060645+0000","last_fullsized":"2024-09-19T07:07:15.060645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:31.999600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.811839+0000","last_change":"2024-09-19T07:06:22.658629+0000","last_active":"2024-09-19T07:07:15.811839+0000","last_peered":"2024-09-19T07:07:15.811839+0000","last_clean":"2024-09-19T07:07:15.811839+0000","last_became_active":"2024-09-19T07:06:22.658123+0000","last_became_peered":"2024-09-19T07:06:22.658123+0000","last_unstale":"2024-09-19T07:07:15.811839+0000","last_undegraded":"2024-09-19T07:07:15.811839+0000","last_fullsized":"2024-09-19T07:07:15.811839+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:29.809725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058971+0000","last_change":"2024-09-19T07:06:31.833527+0000","last_active":"2024-09-19T07:07:15.058971+0000","last_peered":"2024-09-19T07:07:15.058971+0000","last_clean":"2024-09-19T07:07:15.058971+0000","last_became_active":"2024-09-19T07:06:31.833190+0000","last_became_peered":"2024-09-19T07:06:31.833190+0000","last_unstale":"2024-09-19T07:07:15.058971+0000","last_undegraded":"2024-09-19T07:07:15.058971+0000","last_fullsized":"2024-09-19T07:07:15.058971+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:23.456499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057010+0000","last_change":"2024-09-19T07:06:24.776025+0000","last_active":"2024-09-19T07:07:15.057010+0000","last_peered":"2024-09-19T07:07:15.057010+0000","last_clean":"2024-09-19T07:07:15.057010+0000","last_became_active":"2024-09-19T07:06:24.775713+0000","last_became_peered":"2024-09-19T07:06:24.775713+0000","last_unstale":"2024-09-19T07:07:15.057010+0000","last_undegraded":"2024-09-19T07:07:15.057010+0000","last_fullsized":"2024-09-19T07:07:15.057010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:56.250858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064970+0000","last_change":"2024-09-19T07:06:22.755134+0000","last_active":"2024-09-19T07:07:15.064970+0000","last_peered":"2024-09-19T07:07:15.064970+0000","last_clean":"2024-09-19T07:07:15.064970+0000","last_became_active":"2024-09-19T07:06:22.754569+0000","last_became_peered":"2024-09-19T07:06:22.754569+0000","last_unstale":"2024-09-19T07:07:15.064970+0000","last_undegraded":"2024-09-19T07:07:15.064970+0000","last_fullsized":"2024-09-19T07:07:15.064970+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:19.821699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062074+0000","last_change":"2024-09-19T07:06:31.832740+0000","last_active":"2024-09-19T07:07:15.062074+0000","last_peered":"2024-09-19T07:07:15.062074+0000","last_clean":"2024-09-19T07:07:15.062074+0000","last_became_active":"2024-09-19T07:06:31.832324+0000","last_became_peered":"2024-09-19T07:06:31.832324+0000","last_unstale":"2024-09-19T07:07:15.062074+0000","last_undegraded":"2024-09-19T07:07:15.062074+0000","last_fullsized":"2024-09-19T07:07:15.062074+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061661+0000","last_change":"2024-09-19T07:06:24.779696+0000","last_active":"2024-09-19T07:07:15.061661+0000","last_peered":"2024-09-19T07:07:15.061661+0000","last_clean":"2024-09-19T07:07:15.061661+0000","last_became_active":"2024-09-19T07:06:24.779395+0000","last_became_peered":"2024-09-19T07:06:24.779395+0000","last_unstale":"2024-09-19T07:07:15.061661+0000","last_undegraded":"2024-09-19T07:07:15.061661+0000","last_fullsized":"2024-09-19T07:07:15.061661+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:04.636305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060362+0000","last_change":"2024-09-19T07:06:22.753418+0000","last_active":"2024-09-19T07:07:15.060362+0000","last_peered":"2024-09-19T07:07:15.060362+0000","last_clean":"2024-09-19T07:07:15.060362+0000","last_became_active":"2024-09-19T07:06:22.752961+0000","last_became_peered":"2024-09-19T07:06:22.752961+0000","last_unstale":"2024-09-19T07:07:15.060362+0000","last_undegraded":"2024-09-19T07:07:15.060362+0000","last_fullsized":"2024-09-19T07:07:15.060362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:05.780538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062221+0000","last_change":"2024-09-19T07:06:31.832361+0000","last_active":"2024-09-19T07:07:15.062221+0000","last_peered":"2024-09-19T07:07:15.062221+0000","last_clean":"2024-09-19T07:07:15.062221+0000","last_became_active":"2024-09-19T07:06:31.831944+0000","last_became_peered":"2024-09-19T07:06:31.831944+0000","last_unstale":"2024-09-19T07:07:15.062221+0000","last_undegraded":"2024-09-19T07:07:15.062221+0000","last_fullsized":"2024-09-19T07:07:15.062221+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.498667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062339+0000","last_change":"2024-09-19T07:06:24.780370+0000","last_active":"2024-09-19T07:07:15.062339+0000","last_peered":"2024-09-19T07:07:15.062339+0000","last_clean":"2024-09-19T07:07:15.062339+0000","last_became_active":"2024-09-19T07:06:24.780067+0000","last_became_peered":"2024-09-19T07:06:24.780067+0000","last_unstale":"2024-09-19T07:07:15.062339+0000","last_undegraded":"2024-09-19T07:07:15.062339+0000","last_fullsized":"2024-09-19T07:07:15.062339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:09.869972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057803+0000","last_change":"2024-09-19T07:06:22.665645+0000","last_active":"2024-09-19T07:07:15.057803+0000","last_peered":"2024-09-19T07:07:15.057803+0000","last_clean":"2024-09-19T07:07:15.057803+0000","last_became_active":"2024-09-19T07:06:22.665277+0000","last_became_peered":"2024-09-19T07:06:22.665277+0000","last_unstale":"2024-09-19T07:07:15.057803+0000","last_undegraded":"2024-09-19T07:07:15.057803+0000","last_fullsized":"2024-09-19T07:07:15.057803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:54.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056887+0000","last_change":"2024-09-19T07:06:31.828458+0000","last_active":"2024-09-19T07:07:15.056887+0000","last_peered":"2024-09-19T07:07:15.056887+0000","last_clean":"2024-09-19T07:07:15.056887+0000","last_became_active":"2024-09-19T07:06:31.828040+0000","last_became_peered":"2024-09-19T07:06:31.828040+0000","last_unstale":"2024-09-19T07:07:15.056887+0000","last_undegraded":"2024-09-19T07:07:15.056887+0000","last_fullsized":"2024-09-19T07:07:15.056887+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:23:12.820316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057741+0000","last_change":"2024-09-19T07:06:24.779631+0000","last_active":"2024-09-19T07:07:15.057741+0000","last_peered":"2024-09-19T07:07:15.057741+0000","last_clean":"2024-09-19T07:07:15.057741+0000","last_became_active":"2024-09-19T07:06:24.779359+0000","last_became_peered":"2024-09-19T07:06:24.779359+0000","last_unstale":"2024-09-19T07:07:15.057741+0000","last_undegraded":"2024-09-19T07:07:15.057741+0000","last_fullsized":"2024-09-19T07:07:15.057741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:29.268512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056666+0000","last_change":"2024-09-19T07:06:22.753145+0000","last_active":"2024-09-19T07:07:15.056666+0000","last_peered":"2024-09-19T07:07:15.056666+0000","last_clean":"2024-09-19T07:07:15.056666+0000","last_became_active":"2024-09-19T07:06:22.752813+0000","last_became_peered":"2024-09-19T07:06:22.752813+0000","last_unstale":"2024-09-19T07:07:15.056666+0000","last_undegraded":"2024-09-19T07:07:15.056666+0000","last_fullsized":"2024-09-19T07:07:15.056666+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:59:03.591693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057025+0000","last_change":"2024-09-19T07:06:31.839105+0000","last_active":"2024-09-19T07:07:15.057025+0000","last_peered":"2024-09-19T07:07:15.057025+0000","last_clean":"2024-09-19T07:07:15.057025+0000","last_became_active":"2024-09-19T07:06:31.838746+0000","last_became_peered":"2024-09-19T07:06:31.838746+0000","last_unstale":"2024-09-19T07:07:15.057025+0000","last_undegraded":"2024-09-19T07:07:15.057025+0000","last_fullsized":"2024-09-19T07:07:15.057025+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:55.095413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056535+0000","last_change":"2024-09-19T07:06:24.776827+0000","last_active":"2024-09-19T07:07:15.056535+0000","last_peered":"2024-09-19T07:07:15.056535+0000","last_clean":"2024-09-19T07:07:15.056535+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.056535+0000","last_undegraded":"2024-09-19T07:07:15.056535+0000","last_fullsized":"2024-09-19T07:07:15.056535+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:58.508545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057367+0000","last_change":"2024-09-19T07:06:22.667546+0000","last_active":"2024-09-19T07:07:15.057367+0000","last_peered":"2024-09-19T07:07:15.057367+0000","last_clean":"2024-09-19T07:07:15.057367+0000","last_became_active":"2024-09-19T07:06:22.666834+0000","last_became_peered":"2024-09-19T07:06:22.666834+0000","last_unstale":"2024-09-19T07:07:15.057367+0000","last_undegraded":"2024-09-19T07:07:15.057367+0000","last_fullsized":"2024-09-19T07:07:15.057367+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:46.203387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058690+0000","last_change":"2024-09-19T07:06:31.833371+0000","last_active":"2024-09-19T07:07:15.058690+0000","last_peered":"2024-09-19T07:07:15.058690+0000","last_clean":"2024-09-19T07:07:15.058690+0000","last_became_active":"2024-09-19T07:06:31.832904+0000","last_became_peered":"2024-09-19T07:06:31.832904+0000","last_unstale":"2024-09-19T07:07:15.058690+0000","last_undegraded":"2024-09-19T07:07:15.058690+0000","last_fullsized":"2024-09-19T07:07:15.058690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:35:07.253922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059640+0000","last_change":"2024-09-19T07:06:24.782272+0000","last_active":"2024-09-19T07:07:15.059640+0000","last_peered":"2024-09-19T07:07:15.059640+0000","last_clean":"2024-09-19T07:07:15.059640+0000","last_became_active":"2024-09-19T07:06:24.781466+0000","last_became_peered":"2024-09-19T07:06:24.781466+0000","last_unstale":"2024-09-19T07:07:15.059640+0000","last_undegraded":"2024-09-19T07:07:15.059640+0000","last_fullsized":"2024-09-19T07:07:15.059640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:04.562330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061668+0000","last_change":"2024-09-19T07:06:22.659949+0000","last_active":"2024-09-19T07:07:15.061668+0000","last_peered":"2024-09-19T07:07:15.061668+0000","last_clean":"2024-09-19T07:07:15.061668+0000","last_became_active":"2024-09-19T07:06:22.659482+0000","last_became_peered":"2024-09-19T07:06:22.659482+0000","last_unstale":"2024-09-19T07:07:15.061668+0000","last_undegraded":"2024-09-19T07:07:15.061668+0000","last_fullsized":"2024-09-19T07:07:15.061668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:47.002865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":352,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057644+0000","last_change":"2024-09-19T07:05:09.883529+0000","last_active":"2024-09-19T07:07:15.057644+0000","last_peered":"2024-09-19T07:07:15.057644+0000","last_clean":"2024-09-19T07:07:15.057644+0000","last_became_active":"2024-09-19T07:05:09.883043+0000","last_became_peered":"2024-09-19T07:05:09.883043+0000","last_unstale":"2024-09-19T07:07:15.057644+0000","last_undegraded":"2024-09-19T07:07:15.057644+0000","last_fullsized":"2024-09-19T07:07:15.057644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:01:36.430980+0000","last_clean_scrub_stamp":"2024-09-19T07:01:36.430980+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:48.301411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057967+0000","last_change":"2024-09-19T07:06:31.833144+0000","last_active":"2024-09-19T07:07:15.057967+0000","last_peered":"2024-09-19T07:07:15.057967+0000","last_clean":"2024-09-19T07:07:15.057967+0000","last_became_active":"2024-09-19T07:06:31.832697+0000","last_became_peered":"2024-09-19T07:06:31.832697+0000","last_unstale":"2024-09-19T07:07:15.057967+0000","last_undegraded":"2024-09-19T07:07:15.057967+0000","last_fullsized":"2024-09-19T07:07:15.057967+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:45.770685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058117+0000","last_change":"2024-09-19T07:06:24.790541+0000","last_active":"2024-09-19T07:07:15.058117+0000","last_peered":"2024-09-19T07:07:15.058117+0000","last_clean":"2024-09-19T07:07:15.058117+0000","last_became_active":"2024-09-19T07:06:24.789508+0000","last_became_peered":"2024-09-19T07:06:24.789508+0000","last_unstale":"2024-09-19T07:07:15.058117+0000","last_undegraded":"2024-09-19T07:07:15.058117+0000","last_fullsized":"2024-09-19T07:07:15.058117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:25:05.045018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060915+0000","last_change":"2024-09-19T07:06:22.755207+0000","last_active":"2024-09-19T07:07:15.060915+0000","last_peered":"2024-09-19T07:07:15.060915+0000","last_clean":"2024-09-19T07:07:15.060915+0000","last_became_active":"2024-09-19T07:06:22.754792+0000","last_became_peered":"2024-09-19T07:06:22.754792+0000","last_unstale":"2024-09-19T07:07:15.060915+0000","last_undegraded":"2024-09-19T07:07:15.060915+0000","last_fullsized":"2024-09-19T07:07:15.060915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:26.662470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086015+0000","last_change":"2024-09-19T07:06:31.826209+0000","last_active":"2024-09-19T07:07:15.086015+0000","last_peered":"2024-09-19T07:07:15.086015+0000","last_clean":"2024-09-19T07:07:15.086015+0000","last_became_active":"2024-09-19T07:06:31.825797+0000","last_became_peered":"2024-09-19T07:06:31.825797+0000","last_unstale":"2024-09-19T07:07:15.086015+0000","last_undegraded":"2024-09-19T07:07:15.086015+0000","last_fullsized":"2024-09-19T07:07:15.086015+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:51.496594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057878+0000","last_change":"2024-09-19T07:06:24.786404+0000","last_active":"2024-09-19T07:07:15.057878+0000","last_peered":"2024-09-19T07:07:15.057878+0000","last_clean":"2024-09-19T07:07:15.057878+0000","last_became_active":"2024-09-19T07:06:24.786107+0000","last_became_peered":"2024-09-19T07:06:24.786107+0000","last_unstale":"2024-09-19T07:07:15.057878+0000","last_undegraded":"2024-09-19T07:07:15.057878+0000","last_fullsized":"2024-09-19T07:07:15.057878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:27.955595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058713+0000","last_change":"2024-09-19T07:06:22.664159+0000","last_active":"2024-09-19T07:07:15.058713+0000","last_peered":"2024-09-19T07:07:15.058713+0000","last_clean":"2024-09-19T07:07:15.058713+0000","last_became_active":"2024-09-19T07:06:22.663767+0000","last_became_peered":"2024-09-19T07:06:22.663767+0000","last_unstale":"2024-09-19T07:07:15.058713+0000","last_undegraded":"2024-09-19T07:07:15.058713+0000","last_fullsized":"2024-09-19T07:07:15.058713+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.003064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177840+0000","last_change":"2024-09-19T07:06:31.837427+0000","last_active":"2024-09-19T07:07:15.177840+0000","last_peered":"2024-09-19T07:07:15.177840+0000","last_clean":"2024-09-19T07:07:15.177840+0000","last_became_active":"2024-09-19T07:06:31.836826+0000","last_became_peered":"2024-09-19T07:06:31.836826+0000","last_unstale":"2024-09-19T07:07:15.177840+0000","last_undegraded":"2024-09-19T07:07:15.177840+0000","last_fullsized":"2024-09-19T07:07:15.177840+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:58:53.513740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058017+0000","last_change":"2024-09-19T07:06:24.780041+0000","last_active":"2024-09-19T07:07:15.058017+0000","last_peered":"2024-09-19T07:07:15.058017+0000","last_clean":"2024-09-19T07:07:15.058017+0000","last_became_active":"2024-09-19T07:06:24.779729+0000","last_became_peered":"2024-09-19T07:06:24.779729+0000","last_unstale":"2024-09-19T07:07:15.058017+0000","last_undegraded":"2024-09-19T07:07:15.058017+0000","last_fullsized":"2024-09-19T07:07:15.058017+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:34.578982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'2","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067483+0000","last_change":"2024-09-19T07:07:15.067483+0000","last_active":"2024-09-19T07:07:15.067483+0000","last_peered":"2024-09-19T07:07:15.067483+0000","last_clean":"2024-09-19T07:07:15.067483+0000","last_became_active":"2024-09-19T07:07:15.064076+0000","last_became_peered":"2024-09-19T07:07:15.064076+0000","last_unstale":"2024-09-19T07:07:15.067483+0000","last_undegraded":"2024-09-19T07:07:15.067483+0000","last_fullsized":"2024-09-19T07:07:15.067483+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:42.280206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057614+0000","last_change":"2024-09-19T07:06:31.829116+0000","last_active":"2024-09-19T07:07:15.057614+0000","last_peered":"2024-09-19T07:07:15.057614+0000","last_clean":"2024-09-19T07:07:15.057614+0000","last_became_active":"2024-09-19T07:06:31.828615+0000","last_became_peered":"2024-09-19T07:06:31.828615+0000","last_unstale":"2024-09-19T07:07:15.057614+0000","last_undegraded":"2024-09-19T07:07:15.057614+0000","last_fullsized":"2024-09-19T07:07:15.057614+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:09.388320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063452+0000","last_change":"2024-09-19T07:06:24.783661+0000","last_active":"2024-09-19T07:07:15.063452+0000","last_peered":"2024-09-19T07:07:15.063452+0000","last_clean":"2024-09-19T07:07:15.063452+0000","last_became_active":"2024-09-19T07:06:24.783394+0000","last_became_peered":"2024-09-19T07:06:24.783394+0000","last_unstale":"2024-09-19T07:07:15.063452+0000","last_undegraded":"2024-09-19T07:07:15.063452+0000","last_fullsized":"2024-09-19T07:07:15.063452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:26.944373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"82'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.070425+0000","last_change":"2024-09-19T07:07:15.069990+0000","last_active":"2024-09-19T07:07:15.070425+0000","last_peered":"2024-09-19T07:07:15.070425+0000","last_clean":"2024-09-19T07:07:15.070425+0000","last_became_active":"2024-09-19T07:07:15.064494+0000","last_became_peered":"2024-09-19T07:07:15.064494+0000","last_unstale":"2024-09-19T07:07:15.070425+0000","last_undegraded":"2024-09-19T07:07:15.070425+0000","last_fullsized":"2024-09-19T07:07:15.070425+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:45.233325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057683+0000","last_change":"2024-09-19T07:06:31.831305+0000","last_active":"2024-09-19T07:07:15.057683+0000","last_peered":"2024-09-19T07:07:15.057683+0000","last_clean":"2024-09-19T07:07:15.057683+0000","last_became_active":"2024-09-19T07:06:31.830945+0000","last_became_peered":"2024-09-19T07:06:31.830945+0000","last_unstale":"2024-09-19T07:07:15.057683+0000","last_undegraded":"2024-09-19T07:07:15.057683+0000","last_fullsized":"2024-09-19T07:07:15.057683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:08.418520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057775+0000","last_change":"2024-09-19T07:06:24.780874+0000","last_active":"2024-09-19T07:07:15.057775+0000","last_peered":"2024-09-19T07:07:15.057775+0000","last_clean":"2024-09-19T07:07:15.057775+0000","last_became_active":"2024-09-19T07:06:24.780563+0000","last_became_peered":"2024-09-19T07:06:24.780563+0000","last_unstale":"2024-09-19T07:07:15.057775+0000","last_undegraded":"2024-09-19T07:07:15.057775+0000","last_fullsized":"2024-09-19T07:07:15.057775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:25.787893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"82'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062951+0000","last_change":"2024-09-19T07:06:22.753233+0000","last_active":"2024-09-19T07:07:15.062951+0000","last_peered":"2024-09-19T07:07:15.062951+0000","last_clean":"2024-09-19T07:07:15.062951+0000","last_became_active":"2024-09-19T07:06:22.752822+0000","last_became_peered":"2024-09-19T07:06:22.752822+0000","last_unstale":"2024-09-19T07:07:15.062951+0000","last_undegraded":"2024-09-19T07:07:15.062951+0000","last_fullsized":"2024-09-19T07:07:15.062951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:33:50.586782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057175+0000","last_change":"2024-09-19T07:06:31.839585+0000","last_active":"2024-09-19T07:07:15.057175+0000","last_peered":"2024-09-19T07:07:15.057175+0000","last_clean":"2024-09-19T07:07:15.057175+0000","last_became_active":"2024-09-19T07:06:31.839218+0000","last_became_peered":"2024-09-19T07:06:31.839218+0000","last_unstale":"2024-09-19T07:07:15.057175+0000","last_undegraded":"2024-09-19T07:07:15.057175+0000","last_fullsized":"2024-09-19T07:07:15.057175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:01.238777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057263+0000","last_change":"2024-09-19T07:06:24.784149+0000","last_active":"2024-09-19T07:07:15.057263+0000","last_peered":"2024-09-19T07:07:15.057263+0000","last_clean":"2024-09-19T07:07:15.057263+0000","last_became_active":"2024-09-19T07:06:24.783705+0000","last_became_peered":"2024-09-19T07:06:24.783705+0000","last_unstale":"2024-09-19T07:07:15.057263+0000","last_undegraded":"2024-09-19T07:07:15.057263+0000","last_fullsized":"2024-09-19T07:07:15.057263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:22.966005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060703+0000","last_change":"2024-09-19T07:06:22.663019+0000","last_active":"2024-09-19T07:07:15.060703+0000","last_peered":"2024-09-19T07:07:15.060703+0000","last_clean":"2024-09-19T07:07:15.060703+0000","last_became_active":"2024-09-19T07:06:22.662619+0000","last_became_peered":"2024-09-19T07:06:22.662619+0000","last_unstale":"2024-09-19T07:07:15.060703+0000","last_undegraded":"2024-09-19T07:07:15.060703+0000","last_fullsized":"2024-09-19T07:07:15.060703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:07.383883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061227+0000","last_change":"2024-09-19T07:06:31.834020+0000","last_active":"2024-09-19T07:07:15.061227+0000","last_peered":"2024-09-19T07:07:15.061227+0000","last_clean":"2024-09-19T07:07:15.061227+0000","last_became_active":"2024-09-19T07:06:31.833653+0000","last_became_peered":"2024-09-19T07:06:31.833653+0000","last_unstale":"2024-09-19T07:07:15.061227+0000","last_undegraded":"2024-09-19T07:07:15.061227+0000","last_fullsized":"2024-09-19T07:07:15.061227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:46.209791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057574+0000","last_change":"2024-09-19T07:06:24.784415+0000","last_active":"2024-09-19T07:07:15.057574+0000","last_peered":"2024-09-19T07:07:15.057574+0000","last_clean":"2024-09-19T07:07:15.057574+0000","last_became_active":"2024-09-19T07:06:24.784101+0000","last_became_peered":"2024-09-19T07:06:24.784101+0000","last_unstale":"2024-09-19T07:07:15.057574+0000","last_undegraded":"2024-09-19T07:07:15.057574+0000","last_fullsized":"2024-09-19T07:07:15.057574+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:11.938117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057997+0000","last_change":"2024-09-19T07:06:22.666907+0000","last_active":"2024-09-19T07:07:15.057997+0000","last_peered":"2024-09-19T07:07:15.057997+0000","last_clean":"2024-09-19T07:07:15.057997+0000","last_became_active":"2024-09-19T07:06:22.666464+0000","last_became_peered":"2024-09-19T07:06:22.666464+0000","last_unstale":"2024-09-19T07:07:15.057997+0000","last_undegraded":"2024-09-19T07:07:15.057997+0000","last_fullsized":"2024-09-19T07:07:15.057997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:25.070033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062190+0000","last_change":"2024-09-19T07:06:31.831069+0000","last_active":"2024-09-19T07:07:15.062190+0000","last_peered":"2024-09-19T07:07:15.062190+0000","last_clean":"2024-09-19T07:07:15.062190+0000","last_became_active":"2024-09-19T07:06:31.830636+0000","last_became_peered":"2024-09-19T07:06:31.830636+0000","last_unstale":"2024-09-19T07:07:15.062190+0000","last_undegraded":"2024-09-19T07:07:15.062190+0000","last_fullsized":"2024-09-19T07:07:15.062190+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:00.638977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056695+0000","last_change":"2024-09-19T07:06:24.783648+0000","last_active":"2024-09-19T07:07:15.056695+0000","last_peered":"2024-09-19T07:07:15.056695+0000","last_clean":"2024-09-19T07:07:15.056695+0000","last_became_active":"2024-09-19T07:06:24.783384+0000","last_became_peered":"2024-09-19T07:06:24.783384+0000","last_unstale":"2024-09-19T07:07:15.056695+0000","last_undegraded":"2024-09-19T07:07:15.056695+0000","last_fullsized":"2024-09-19T07:07:15.056695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:23.203497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"82'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060951+0000","last_change":"2024-09-19T07:06:22.667192+0000","last_active":"2024-09-19T07:07:15.060951+0000","last_peered":"2024-09-19T07:07:15.060951+0000","last_clean":"2024-09-19T07:07:15.060951+0000","last_became_active":"2024-09-19T07:06:22.666865+0000","last_became_peered":"2024-09-19T07:06:22.666865+0000","last_unstale":"2024-09-19T07:07:15.060951+0000","last_undegraded":"2024-09-19T07:07:15.060951+0000","last_fullsized":"2024-09-19T07:07:15.060951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:42.480468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058263+0000","last_change":"2024-09-19T07:06:31.830299+0000","last_active":"2024-09-19T07:07:15.058263+0000","last_peered":"2024-09-19T07:07:15.058263+0000","last_clean":"2024-09-19T07:07:15.058263+0000","last_became_active":"2024-09-19T07:06:31.829879+0000","last_became_peered":"2024-09-19T07:06:31.829879+0000","last_unstale":"2024-09-19T07:07:15.058263+0000","last_undegraded":"2024-09-19T07:07:15.058263+0000","last_fullsized":"2024-09-19T07:07:15.058263+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:52:36.361521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064712+0000","last_change":"2024-09-19T07:06:24.783313+0000","last_active":"2024-09-19T07:07:15.064712+0000","last_peered":"2024-09-19T07:07:15.064712+0000","last_clean":"2024-09-19T07:07:15.064712+0000","last_became_active":"2024-09-19T07:06:24.783014+0000","last_became_peered":"2024-09-19T07:06:24.783014+0000","last_unstale":"2024-09-19T07:07:15.064712+0000","last_undegraded":"2024-09-19T07:07:15.064712+0000","last_fullsized":"2024-09-19T07:07:15.064712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.582164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'30","reported_seq":204,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:08:06.115301+0000","last_change":"2024-09-19T07:06:22.668201+0000","last_active":"2024-09-19T07:08:06.115301+0000","last_peered":"2024-09-19T07:08:06.115301+0000","last_clean":"2024-09-19T07:08:06.115301+0000","last_became_active":"2024-09-19T07:06:22.667802+0000","last_became_peered":"2024-09-19T07:06:22.667802+0000","last_unstale":"2024-09-19T07:08:06.115301+0000","last_undegraded":"2024-09-19T07:08:06.115301+0000","last_fullsized":"2024-09-19T07:08:06.115301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:09.259823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":140,"num_read_kb":132,"num_write":30,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060105+0000","last_change":"2024-09-19T07:06:31.833076+0000","last_active":"2024-09-19T07:07:15.060105+0000","last_peered":"2024-09-19T07:07:15.060105+0000","last_clean":"2024-09-19T07:07:15.060105+0000","last_became_active":"2024-09-19T07:06:31.832687+0000","last_became_peered":"2024-09-19T07:06:31.832687+0000","last_unstale":"2024-09-19T07:07:15.060105+0000","last_undegraded":"2024-09-19T07:07:15.060105+0000","last_fullsized":"2024-09-19T07:07:15.060105+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:01.448361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086241+0000","last_change":"2024-09-19T07:06:24.776718+0000","last_active":"2024-09-19T07:07:15.086241+0000","last_peered":"2024-09-19T07:07:15.086241+0000","last_clean":"2024-09-19T07:07:15.086241+0000","last_became_active":"2024-09-19T07:06:24.776354+0000","last_became_peered":"2024-09-19T07:06:24.776354+0000","last_unstale":"2024-09-19T07:07:15.086241+0000","last_undegraded":"2024-09-19T07:07:15.086241+0000","last_fullsized":"2024-09-19T07:07:15.086241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:43:47.753532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"82'3","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058608+0000","last_change":"2024-09-19T07:06:22.753947+0000","last_active":"2024-09-19T07:07:15.058608+0000","last_peered":"2024-09-19T07:07:15.058608+0000","last_clean":"2024-09-19T07:07:15.058608+0000","last_became_active":"2024-09-19T07:06:22.753425+0000","last_became_peered":"2024-09-19T07:06:22.753425+0000","last_unstale":"2024-09-19T07:07:15.058608+0000","last_undegraded":"2024-09-19T07:07:15.058608+0000","last_fullsized":"2024-09-19T07:07:15.058608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:09.178288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061390+0000","last_change":"2024-09-19T07:06:31.840716+0000","last_active":"2024-09-19T07:07:15.061390+0000","last_peered":"2024-09-19T07:07:15.061390+0000","last_clean":"2024-09-19T07:07:15.061390+0000","last_became_active":"2024-09-19T07:06:31.840106+0000","last_became_peered":"2024-09-19T07:06:31.840106+0000","last_unstale":"2024-09-19T07:07:15.061390+0000","last_undegraded":"2024-09-19T07:07:15.061390+0000","last_fullsized":"2024-09-19T07:07:15.061390+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:20.746612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178243+0000","last_change":"2024-09-19T07:06:24.783982+0000","last_active":"2024-09-19T07:07:15.178243+0000","last_peered":"2024-09-19T07:07:15.178243+0000","last_clean":"2024-09-19T07:07:15.178243+0000","last_became_active":"2024-09-19T07:06:24.783690+0000","last_became_peered":"2024-09-19T07:06:24.783690+0000","last_unstale":"2024-09-19T07:07:15.178243+0000","last_undegraded":"2024-09-19T07:07:15.178243+0000","last_fullsized":"2024-09-19T07:07:15.178243+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:30.457381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058019+0000","last_change":"2024-09-19T07:06:22.670170+0000","last_active":"2024-09-19T07:07:15.058019+0000","last_peered":"2024-09-19T07:07:15.058019+0000","last_clean":"2024-09-19T07:07:15.058019+0000","last_became_active":"2024-09-19T07:06:22.669827+0000","last_became_peered":"2024-09-19T07:06:22.669827+0000","last_unstale":"2024-09-19T07:07:15.058019+0000","last_undegraded":"2024-09-19T07:07:15.058019+0000","last_fullsized":"2024-09-19T07:07:15.058019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:42.804492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059369+0000","last_change":"2024-09-19T07:06:31.831408+0000","last_active":"2024-09-19T07:07:15.059369+0000","last_peered":"2024-09-19T07:07:15.059369+0000","last_clean":"2024-09-19T07:07:15.059369+0000","last_became_active":"2024-09-19T07:06:31.831043+0000","last_became_peered":"2024-09-19T07:06:31.831043+0000","last_unstale":"2024-09-19T07:07:15.059369+0000","last_undegraded":"2024-09-19T07:07:15.059369+0000","last_fullsized":"2024-09-19T07:07:15.059369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:41.320316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086511+0000","last_change":"2024-09-19T07:06:24.781974+0000","last_active":"2024-09-19T07:07:15.086511+0000","last_peered":"2024-09-19T07:07:15.086511+0000","last_clean":"2024-09-19T07:07:15.086511+0000","last_became_active":"2024-09-19T07:06:24.774826+0000","last_became_peered":"2024-09-19T07:06:24.774826+0000","last_unstale":"2024-09-19T07:07:15.086511+0000","last_undegraded":"2024-09-19T07:07:15.086511+0000","last_fullsized":"2024-09-19T07:07:15.086511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:42.018370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062233+0000","last_change":"2024-09-19T07:06:22.664171+0000","last_active":"2024-09-19T07:07:15.062233+0000","last_peered":"2024-09-19T07:07:15.062233+0000","last_clean":"2024-09-19T07:07:15.062233+0000","last_became_active":"2024-09-19T07:06:22.663735+0000","last_became_peered":"2024-09-19T07:06:22.663735+0000","last_unstale":"2024-09-19T07:07:15.062233+0000","last_undegraded":"2024-09-19T07:07:15.062233+0000","last_fullsized":"2024-09-19T07:07:15.062233+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:46.673968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059669+0000","last_change":"2024-09-19T07:06:31.838456+0000","last_active":"2024-09-19T07:07:15.059669+0000","last_peered":"2024-09-19T07:07:15.059669+0000","last_clean":"2024-09-19T07:07:15.059669+0000","last_became_active":"2024-09-19T07:06:31.837933+0000","last_became_peered":"2024-09-19T07:06:31.837933+0000","last_unstale":"2024-09-19T07:07:15.059669+0000","last_undegraded":"2024-09-19T07:07:15.059669+0000","last_fullsized":"2024-09-19T07:07:15.059669+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:23.043705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177946+0000","last_change":"2024-09-19T07:06:31.833537+0000","last_active":"2024-09-19T07:07:15.177946+0000","last_peered":"2024-09-19T07:07:15.177946+0000","last_clean":"2024-09-19T07:07:15.177946+0000","last_became_active":"2024-09-19T07:06:31.833163+0000","last_became_peered":"2024-09-19T07:06:31.833163+0000","last_unstale":"2024-09-19T07:07:15.177946+0000","last_undegraded":"2024-09-19T07:07:15.177946+0000","last_fullsized":"2024-09-19T07:07:15.177946+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:27:30.604793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059855+0000","last_change":"2024-09-19T07:06:24.779147+0000","last_active":"2024-09-19T07:07:15.059855+0000","last_peered":"2024-09-19T07:07:15.059855+0000","last_clean":"2024-09-19T07:07:15.059855+0000","last_became_active":"2024-09-19T07:06:24.778868+0000","last_became_peered":"2024-09-19T07:06:24.778868+0000","last_unstale":"2024-09-19T07:07:15.059855+0000","last_undegraded":"2024-09-19T07:07:15.059855+0000","last_fullsized":"2024-09-19T07:07:15.059855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:49:40.467914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057987+0000","last_change":"2024-09-19T07:06:22.666920+0000","last_active":"2024-09-19T07:07:15.057987+0000","last_peered":"2024-09-19T07:07:15.057987+0000","last_clean":"2024-09-19T07:07:15.057987+0000","last_became_active":"2024-09-19T07:06:22.665971+0000","last_became_peered":"2024-09-19T07:06:22.665971+0000","last_unstale":"2024-09-19T07:07:15.057987+0000","last_undegraded":"2024-09-19T07:07:15.057987+0000","last_fullsized":"2024-09-19T07:07:15.057987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:31:35.338827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.179142+0000","last_change":"2024-09-19T07:07:15.179142+0000","last_active":"2024-09-19T07:07:15.179142+0000","last_peered":"2024-09-19T07:07:15.179142+0000","last_clean":"2024-09-19T07:07:15.179142+0000","last_became_active":"2024-09-19T07:07:15.178586+0000","last_became_peered":"2024-09-19T07:07:15.178586+0000","last_unstale":"2024-09-19T07:07:15.179142+0000","last_undegraded":"2024-09-19T07:07:15.179142+0000","last_fullsized":"2024-09-19T07:07:15.179142+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:24.288315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059113+0000","last_change":"2024-09-19T07:06:24.783908+0000","last_active":"2024-09-19T07:07:15.059113+0000","last_peered":"2024-09-19T07:07:15.059113+0000","last_clean":"2024-09-19T07:07:15.059113+0000","last_became_active":"2024-09-19T07:06:24.783560+0000","last_became_peered":"2024-09-19T07:06:24.783560+0000","last_unstale":"2024-09-19T07:07:15.059113+0000","last_undegraded":"2024-09-19T07:07:15.059113+0000","last_fullsized":"2024-09-19T07:07:15.059113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:30.991280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056560+0000","last_change":"2024-09-19T07:06:22.661599+0000","last_active":"2024-09-19T07:07:15.056560+0000","last_peered":"2024-09-19T07:07:15.056560+0000","last_clean":"2024-09-19T07:07:15.056560+0000","last_became_active":"2024-09-19T07:06:22.661188+0000","last_became_peered":"2024-09-19T07:06:22.661188+0000","last_unstale":"2024-09-19T07:07:15.056560+0000","last_undegraded":"2024-09-19T07:07:15.056560+0000","last_fullsized":"2024-09-19T07:07:15.056560+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:56.993525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061522+0000","last_change":"2024-09-19T07:06:22.663893+0000","last_active":"2024-09-19T07:07:15.061522+0000","last_peered":"2024-09-19T07:07:15.061522+0000","last_clean":"2024-09-19T07:07:15.061522+0000","last_became_active":"2024-09-19T07:06:22.663375+0000","last_became_peered":"2024-09-19T07:06:22.663375+0000","last_unstale":"2024-09-19T07:07:15.061522+0000","last_undegraded":"2024-09-19T07:07:15.061522+0000","last_fullsized":"2024-09-19T07:07:15.061522+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:17.049993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058324+0000","last_change":"2024-09-19T07:06:24.778890+0000","last_active":"2024-09-19T07:07:15.058324+0000","last_peered":"2024-09-19T07:07:15.058324+0000","last_clean":"2024-09-19T07:07:15.058324+0000","last_became_active":"2024-09-19T07:06:24.778576+0000","last_became_peered":"2024-09-19T07:06:24.778576+0000","last_unstale":"2024-09-19T07:07:15.058324+0000","last_undegraded":"2024-09-19T07:07:15.058324+0000","last_fullsized":"2024-09-19T07:07:15.058324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:14.779731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060554+0000","last_change":"2024-09-19T07:06:31.836526+0000","last_active":"2024-09-19T07:07:15.060554+0000","last_peered":"2024-09-19T07:07:15.060554+0000","last_clean":"2024-09-19T07:07:15.060554+0000","last_became_active":"2024-09-19T07:06:31.836120+0000","last_became_peered":"2024-09-19T07:06:31.836120+0000","last_unstale":"2024-09-19T07:07:15.060554+0000","last_undegraded":"2024-09-19T07:07:15.060554+0000","last_fullsized":"2024-09-19T07:07:15.060554+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:04.331232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"82'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058457+0000","last_change":"2024-09-19T07:06:22.668600+0000","last_active":"2024-09-19T07:07:15.058457+0000","last_peered":"2024-09-19T07:07:15.058457+0000","last_clean":"2024-09-19T07:07:15.058457+0000","last_became_active":"2024-09-19T07:06:22.668221+0000","last_became_peered":"2024-09-19T07:06:22.668221+0000","last_unstale":"2024-09-19T07:07:15.058457+0000","last_undegraded":"2024-09-19T07:07:15.058457+0000","last_fullsized":"2024-09-19T07:07:15.058457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:21.647224+0000","last_clean_scrub_stamp":"2024-09-19T07:06:21.647224+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:20.346717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062435+0000","last_change":"2024-09-19T07:06:24.776042+0000","last_active":"2024-09-19T07:07:15.062435+0000","last_peered":"2024-09-19T07:07:15.062435+0000","last_clean":"2024-09-19T07:07:15.062435+0000","last_became_active":"2024-09-19T07:06:24.775740+0000","last_became_peered":"2024-09-19T07:06:24.775740+0000","last_unstale":"2024-09-19T07:07:15.062435+0000","last_undegraded":"2024-09-19T07:07:15.062435+0000","last_fullsized":"2024-09-19T07:07:15.062435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:19.533519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060679+0000","last_change":"2024-09-19T07:06:31.830193+0000","last_active":"2024-09-19T07:07:15.060679+0000","last_peered":"2024-09-19T07:07:15.060679+0000","last_clean":"2024-09-19T07:07:15.060679+0000","last_became_active":"2024-09-19T07:06:31.829814+0000","last_became_peered":"2024-09-19T07:06:31.829814+0000","last_unstale":"2024-09-19T07:07:15.060679+0000","last_undegraded":"2024-09-19T07:07:15.060679+0000","last_fullsized":"2024-09-19T07:07:15.060679+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:30.809805+0000","last_clean_scrub_stamp":"2024-09-19T07:06:30.809805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:16:16.618062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064296+0000","last_change":"2024-09-19T07:06:24.772772+0000","last_active":"2024-09-19T07:07:15.064296+0000","last_peered":"2024-09-19T07:07:15.064296+0000","last_clean":"2024-09-19T07:07:15.064296+0000","last_became_active":"2024-09-19T07:06:24.771991+0000","last_became_peered":"2024-09-19T07:06:24.771991+0000","last_unstale":"2024-09-19T07:07:15.064296+0000","last_undegraded":"2024-09-19T07:07:15.064296+0000","last_fullsized":"2024-09-19T07:07:15.064296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:34.911767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061064+0000","last_change":"2024-09-19T07:06:24.778708+0000","last_active":"2024-09-19T07:07:15.061064+0000","last_peered":"2024-09-19T07:07:15.061064+0000","last_clean":"2024-09-19T07:07:15.061064+0000","last_became_active":"2024-09-19T07:06:24.778401+0000","last_became_peered":"2024-09-19T07:06:24.778401+0000","last_unstale":"2024-09-19T07:07:15.061064+0000","last_undegraded":"2024-09-19T07:07:15.061064+0000","last_fullsized":"2024-09-19T07:07:15.061064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:21.236253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.784204+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.783912+0000","last_became_peered":"2024-09-19T07:06:24.783912+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:59.985233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177982+0000","last_change":"2024-09-19T07:06:24.788693+0000","last_active":"2024-09-19T07:07:15.177982+0000","last_peered":"2024-09-19T07:07:15.177982+0000","last_clean":"2024-09-19T07:07:15.177982+0000","last_became_active":"2024-09-19T07:06:24.788196+0000","last_became_peered":"2024-09-19T07:06:24.788196+0000","last_unstale":"2024-09-19T07:07:15.177982+0000","last_undegraded":"2024-09-19T07:07:15.177982+0000","last_fullsized":"2024-09-19T07:07:15.177982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:20.723830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057006+0000","last_change":"2024-09-19T07:06:24.777279+0000","last_active":"2024-09-19T07:07:15.057006+0000","last_peered":"2024-09-19T07:07:15.057006+0000","last_clean":"2024-09-19T07:07:15.057006+0000","last_became_active":"2024-09-19T07:06:24.776416+0000","last_became_peered":"2024-09-19T07:06:24.776416+0000","last_unstale":"2024-09-19T07:07:15.057006+0000","last_undegraded":"2024-09-19T07:07:15.057006+0000","last_fullsized":"2024-09-19T07:07:15.057006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:08.667864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063399+0000","last_change":"2024-09-19T07:06:24.774481+0000","last_active":"2024-09-19T07:07:15.063399+0000","last_peered":"2024-09-19T07:07:15.063399+0000","last_clean":"2024-09-19T07:07:15.063399+0000","last_became_active":"2024-09-19T07:06:24.774202+0000","last_became_peered":"2024-09-19T07:06:24.774202+0000","last_unstale":"2024-09-19T07:07:15.063399+0000","last_undegraded":"2024-09-19T07:07:15.063399+0000","last_fullsized":"2024-09-19T07:07:15.063399+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:30.650399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061443+0000","last_change":"2024-09-19T07:06:24.780790+0000","last_active":"2024-09-19T07:07:15.061443+0000","last_peered":"2024-09-19T07:07:15.061443+0000","last_clean":"2024-09-19T07:07:15.061443+0000","last_became_active":"2024-09-19T07:06:24.780330+0000","last_became_peered":"2024-09-19T07:06:24.780330+0000","last_unstale":"2024-09-19T07:07:15.061443+0000","last_undegraded":"2024-09-19T07:07:15.061443+0000","last_fullsized":"2024-09-19T07:07:15.061443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:11.976250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060552+0000","last_change":"2024-09-19T07:06:24.783228+0000","last_active":"2024-09-19T07:07:15.060552+0000","last_peered":"2024-09-19T07:07:15.060552+0000","last_clean":"2024-09-19T07:07:15.060552+0000","last_became_active":"2024-09-19T07:06:24.782891+0000","last_became_peered":"2024-09-19T07:06:24.782891+0000","last_unstale":"2024-09-19T07:07:15.060552+0000","last_undegraded":"2024-09-19T07:07:15.060552+0000","last_fullsized":"2024-09-19T07:07:15.060552+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:43.879631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057769+0000","last_change":"2024-09-19T07:06:24.777480+0000","last_active":"2024-09-19T07:07:15.057769+0000","last_peered":"2024-09-19T07:07:15.057769+0000","last_clean":"2024-09-19T07:07:15.057769+0000","last_became_active":"2024-09-19T07:06:24.777189+0000","last_became_peered":"2024-09-19T07:06:24.777189+0000","last_unstale":"2024-09-19T07:07:15.057769+0000","last_undegraded":"2024-09-19T07:07:15.057769+0000","last_fullsized":"2024-09-19T07:07:15.057769+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:31.796819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059836+0000","last_change":"2024-09-19T07:06:24.781635+0000","last_active":"2024-09-19T07:07:15.059836+0000","last_peered":"2024-09-19T07:07:15.059836+0000","last_clean":"2024-09-19T07:07:15.059836+0000","last_became_active":"2024-09-19T07:06:24.781194+0000","last_became_peered":"2024-09-19T07:06:24.781194+0000","last_unstale":"2024-09-19T07:07:15.059836+0000","last_undegraded":"2024-09-19T07:07:15.059836+0000","last_fullsized":"2024-09-19T07:07:15.059836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:18:36.452215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086193+0000","last_change":"2024-09-19T07:06:24.790912+0000","last_active":"2024-09-19T07:07:15.086193+0000","last_peered":"2024-09-19T07:07:15.086193+0000","last_clean":"2024-09-19T07:07:15.086193+0000","last_became_active":"2024-09-19T07:06:24.790463+0000","last_became_peered":"2024-09-19T07:06:24.790463+0000","last_unstale":"2024-09-19T07:07:15.086193+0000","last_undegraded":"2024-09-19T07:07:15.086193+0000","last_fullsized":"2024-09-19T07:07:15.086193+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:38.613285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056901+0000","last_change":"2024-09-19T07:06:24.782242+0000","last_active":"2024-09-19T07:07:15.056901+0000","last_peered":"2024-09-19T07:07:15.056901+0000","last_clean":"2024-09-19T07:07:15.056901+0000","last_became_active":"2024-09-19T07:06:24.781926+0000","last_became_peered":"2024-09-19T07:06:24.781926+0000","last_unstale":"2024-09-19T07:07:15.056901+0000","last_undegraded":"2024-09-19T07:07:15.056901+0000","last_fullsized":"2024-09-19T07:07:15.056901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:27.009270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061870+0000","last_change":"2024-09-19T07:06:24.784491+0000","last_active":"2024-09-19T07:07:15.061870+0000","last_peered":"2024-09-19T07:07:15.061870+0000","last_clean":"2024-09-19T07:07:15.061870+0000","last_became_active":"2024-09-19T07:06:24.784185+0000","last_became_peered":"2024-09-19T07:06:24.784185+0000","last_unstale":"2024-09-19T07:07:15.061870+0000","last_undegraded":"2024-09-19T07:07:15.061870+0000","last_fullsized":"2024-09-19T07:07:15.061870+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:55.593890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060881+0000","last_change":"2024-09-19T07:06:24.785662+0000","last_active":"2024-09-19T07:07:15.060881+0000","last_peered":"2024-09-19T07:07:15.060881+0000","last_clean":"2024-09-19T07:07:15.060881+0000","last_became_active":"2024-09-19T07:06:24.784803+0000","last_became_peered":"2024-09-19T07:06:24.784803+0000","last_unstale":"2024-09-19T07:07:15.060881+0000","last_undegraded":"2024-09-19T07:07:15.060881+0000","last_fullsized":"2024-09-19T07:07:15.060881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:09.454764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.060878+0000","last_change":"2024-09-19T07:06:24.777776+0000","last_active":"2024-09-19T07:07:15.060878+0000","last_peered":"2024-09-19T07:07:15.060878+0000","last_clean":"2024-09-19T07:07:15.060878+0000","last_became_active":"2024-09-19T07:06:24.777289+0000","last_became_peered":"2024-09-19T07:06:24.777289+0000","last_unstale":"2024-09-19T07:07:15.060878+0000","last_undegraded":"2024-09-19T07:07:15.060878+0000","last_fullsized":"2024-09-19T07:07:15.060878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:10.358161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.063278+0000","last_change":"2024-09-19T07:06:24.778619+0000","last_active":"2024-09-19T07:07:15.063278+0000","last_peered":"2024-09-19T07:07:15.063278+0000","last_clean":"2024-09-19T07:07:15.063278+0000","last_became_active":"2024-09-19T07:06:24.778018+0000","last_became_peered":"2024-09-19T07:06:24.778018+0000","last_unstale":"2024-09-19T07:07:15.063278+0000","last_undegraded":"2024-09-19T07:07:15.063278+0000","last_fullsized":"2024-09-19T07:07:15.063278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:05:28.423396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.085854+0000","last_change":"2024-09-19T07:06:24.781450+0000","last_active":"2024-09-19T07:07:15.085854+0000","last_peered":"2024-09-19T07:07:15.085854+0000","last_clean":"2024-09-19T07:07:15.085854+0000","last_became_active":"2024-09-19T07:06:24.781140+0000","last_became_peered":"2024-09-19T07:06:24.781140+0000","last_unstale":"2024-09-19T07:07:15.085854+0000","last_undegraded":"2024-09-19T07:07:15.085854+0000","last_fullsized":"2024-09-19T07:07:15.085854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:44.299190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177830+0000","last_change":"2024-09-19T07:06:24.782356+0000","last_active":"2024-09-19T07:07:15.177830+0000","last_peered":"2024-09-19T07:07:15.177830+0000","last_clean":"2024-09-19T07:07:15.177830+0000","last_became_active":"2024-09-19T07:06:24.782069+0000","last_became_peered":"2024-09-19T07:06:24.782069+0000","last_unstale":"2024-09-19T07:07:15.177830+0000","last_undegraded":"2024-09-19T07:07:15.177830+0000","last_fullsized":"2024-09-19T07:07:15.177830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:26.822155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177571+0000","last_change":"2024-09-19T07:06:24.774479+0000","last_active":"2024-09-19T07:07:15.177571+0000","last_peered":"2024-09-19T07:07:15.177571+0000","last_clean":"2024-09-19T07:07:15.177571+0000","last_became_active":"2024-09-19T07:06:24.774187+0000","last_became_peered":"2024-09-19T07:06:24.774187+0000","last_unstale":"2024-09-19T07:07:15.177571+0000","last_undegraded":"2024-09-19T07:07:15.177571+0000","last_fullsized":"2024-09-19T07:07:15.177571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:03.463151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.056875+0000","last_change":"2024-09-19T07:06:24.772187+0000","last_active":"2024-09-19T07:07:15.056875+0000","last_peered":"2024-09-19T07:07:15.056875+0000","last_clean":"2024-09-19T07:07:15.056875+0000","last_became_active":"2024-09-19T07:06:24.771826+0000","last_became_peered":"2024-09-19T07:06:24.771826+0000","last_unstale":"2024-09-19T07:07:15.056875+0000","last_undegraded":"2024-09-19T07:07:15.056875+0000","last_fullsized":"2024-09-19T07:07:15.056875+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:27.126968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061384+0000","last_change":"2024-09-19T07:06:24.783153+0000","last_active":"2024-09-19T07:07:15.061384+0000","last_peered":"2024-09-19T07:07:15.061384+0000","last_clean":"2024-09-19T07:07:15.061384+0000","last_became_active":"2024-09-19T07:06:24.782121+0000","last_became_peered":"2024-09-19T07:06:24.782121+0000","last_unstale":"2024-09-19T07:07:15.061384+0000","last_undegraded":"2024-09-19T07:07:15.061384+0000","last_fullsized":"2024-09-19T07:07:15.061384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:27.868414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.058069+0000","last_change":"2024-09-19T07:06:24.790809+0000","last_active":"2024-09-19T07:07:15.058069+0000","last_peered":"2024-09-19T07:07:15.058069+0000","last_clean":"2024-09-19T07:07:15.058069+0000","last_became_active":"2024-09-19T07:06:24.790158+0000","last_became_peered":"2024-09-19T07:06:24.790158+0000","last_unstale":"2024-09-19T07:07:15.058069+0000","last_undegraded":"2024-09-19T07:07:15.058069+0000","last_fullsized":"2024-09-19T07:07:15.058069+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:29.996865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.067182+0000","last_change":"2024-09-19T07:07:15.067182+0000","last_active":"2024-09-19T07:07:15.067182+0000","last_peered":"2024-09-19T07:07:15.067182+0000","last_clean":"2024-09-19T07:07:15.067182+0000","last_became_active":"2024-09-19T07:07:15.066805+0000","last_became_peered":"2024-09-19T07:07:15.066805+0000","last_unstale":"2024-09-19T07:07:15.067182+0000","last_undegraded":"2024-09-19T07:07:15.067182+0000","last_fullsized":"2024-09-19T07:07:15.067182+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:05.606025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.086686+0000","last_change":"2024-09-19T07:06:24.776885+0000","last_active":"2024-09-19T07:07:15.086686+0000","last_peered":"2024-09-19T07:07:15.086686+0000","last_clean":"2024-09-19T07:07:15.086686+0000","last_became_active":"2024-09-19T07:06:24.776370+0000","last_became_peered":"2024-09-19T07:06:24.776370+0000","last_unstale":"2024-09-19T07:07:15.086686+0000","last_undegraded":"2024-09-19T07:07:15.086686+0000","last_fullsized":"2024-09-19T07:07:15.086686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:05.921716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.059089+0000","last_change":"2024-09-19T07:06:24.784352+0000","last_active":"2024-09-19T07:07:15.059089+0000","last_peered":"2024-09-19T07:07:15.059089+0000","last_clean":"2024-09-19T07:07:15.059089+0000","last_became_active":"2024-09-19T07:06:24.783942+0000","last_became_peered":"2024-09-19T07:06:24.783942+0000","last_unstale":"2024-09-19T07:07:15.059089+0000","last_undegraded":"2024-09-19T07:07:15.059089+0000","last_fullsized":"2024-09-19T07:07:15.059089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:00.923627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.057410+0000","last_change":"2024-09-19T07:06:24.783195+0000","last_active":"2024-09-19T07:07:15.057410+0000","last_peered":"2024-09-19T07:07:15.057410+0000","last_clean":"2024-09-19T07:07:15.057410+0000","last_became_active":"2024-09-19T07:06:24.782893+0000","last_became_peered":"2024-09-19T07:06:24.782893+0000","last_unstale":"2024-09-19T07:07:15.057410+0000","last_undegraded":"2024-09-19T07:07:15.057410+0000","last_fullsized":"2024-09-19T07:07:15.057410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:45.201584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061406+0000","last_change":"2024-09-19T07:06:24.781033+0000","last_active":"2024-09-19T07:07:15.061406+0000","last_peered":"2024-09-19T07:07:15.061406+0000","last_clean":"2024-09-19T07:07:15.061406+0000","last_became_active":"2024-09-19T07:06:24.780731+0000","last_became_peered":"2024-09-19T07:06:24.780731+0000","last_unstale":"2024-09-19T07:07:15.061406+0000","last_undegraded":"2024-09-19T07:07:15.061406+0000","last_fullsized":"2024-09-19T07:07:15.061406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:37.748439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.064389+0000","last_change":"2024-09-19T07:06:24.779705+0000","last_active":"2024-09-19T07:07:15.064389+0000","last_peered":"2024-09-19T07:07:15.064389+0000","last_clean":"2024-09-19T07:07:15.064389+0000","last_became_active":"2024-09-19T07:06:24.779392+0000","last_became_peered":"2024-09-19T07:06:24.779392+0000","last_unstale":"2024-09-19T07:07:15.064389+0000","last_undegraded":"2024-09-19T07:07:15.064389+0000","last_fullsized":"2024-09-19T07:07:15.064389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:54.029855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.061304+0000","last_change":"2024-09-19T07:06:24.788288+0000","last_active":"2024-09-19T07:07:15.061304+0000","last_peered":"2024-09-19T07:07:15.061304+0000","last_clean":"2024-09-19T07:07:15.061304+0000","last_became_active":"2024-09-19T07:06:24.788001+0000","last_became_peered":"2024-09-19T07:06:24.788001+0000","last_unstale":"2024-09-19T07:07:15.061304+0000","last_undegraded":"2024-09-19T07:07:15.061304+0000","last_fullsized":"2024-09-19T07:07:15.061304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:40.439031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.177882+0000","last_change":"2024-09-19T07:06:24.776508+0000","last_active":"2024-09-19T07:07:15.177882+0000","last_peered":"2024-09-19T07:07:15.177882+0000","last_clean":"2024-09-19T07:07:15.177882+0000","last_became_active":"2024-09-19T07:06:24.776216+0000","last_became_peered":"2024-09-19T07:06:24.776216+0000","last_unstale":"2024-09-19T07:07:15.177882+0000","last_undegraded":"2024-09-19T07:07:15.177882+0000","last_fullsized":"2024-09-19T07:07:15.177882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:10.905461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.178041+0000","last_change":"2024-09-19T07:06:24.779052+0000","last_active":"2024-09-19T07:07:15.178041+0000","last_peered":"2024-09-19T07:07:15.178041+0000","last_clean":"2024-09-19T07:07:15.178041+0000","last_became_active":"2024-09-19T07:06:24.778708+0000","last_became_peered":"2024-09-19T07:06:24.778708+0000","last_unstale":"2024-09-19T07:07:15.178041+0000","last_undegraded":"2024-09-19T07:07:15.178041+0000","last_fullsized":"2024-09-19T07:07:15.178041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:57.695563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T07:07:15.062462+0000","last_change":"2024-09-19T07:06:24.779673+0000","last_active":"2024-09-19T07:07:15.062462+0000","last_peered":"2024-09-19T07:07:15.062462+0000","last_clean":"2024-09-19T07:07:15.062462+0000","last_became_active":"2024-09-19T07:06:24.779344+0000","last_became_peered":"2024-09-19T07:06:24.779344+0000","last_unstale":"2024-09-19T07:07:15.062462+0000","last_undegraded":"2024-09-19T07:07:15.062462+0000","last_fullsized":"2024-09-19T07:07:15.062462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:06:23.758452+0000","last_clean_scrub_stamp":"2024-09-19T07:06:23.758452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:12.733779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64309,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":145,"num_read_kb":137,"num_write":85,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":604,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":192927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514531,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":69,"seq":296352743463,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1154600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":64,"seq":274877906987,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1024000,"data_stored":509301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168627,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1015808,"data_stored":504623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397559,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1099669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561084,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1011712,"data_stored":500527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1622016,"data_stored":1095173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":504645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":500631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":564072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":564620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1015808,"data_stored":500617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:08:12.319 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:08:12.320 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T07:08:12.320 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T07:08:12.320 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T07:08:12.583 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:12.901 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:12 smithi029 ceph-mon[31255]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:08:12.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:12 smithi078 ceph-mon[34556]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:08:12.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:12 smithi046 ceph-mon[34147]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 -- 172.21.15.29:0/35275957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 msgr2=0x7f4c0810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 --2- 172.21.15.29:0/35275957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0810ea80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009ca0 tx=0x7f4c0002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 -- 172.21.15.29:0/35275957 shutdown_connections 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 --2- 172.21.15.29:0/35275957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0810ea80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 --2- 172.21.15.29:0/35275957 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 0x7f4c081067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 --2- 172.21.15.29:0/35275957 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c08101dd0 0x7f4c081021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 -- 172.21.15.29:0/35275957 >> 172.21.15.29:0/35275957 conn(0x7f4c080fd850 msgr2=0x7f4c080ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 -- 172.21.15.29:0/35275957 shutdown_connections 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.137+0000 7f4c0e660640 1 -- 172.21.15.29:0/35275957 wait complete. 2024-09-19T07:08:13.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 Processor -- start 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 -- start start 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c08101dd0 0x7f4c08198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 0x7f4c081987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111e10 con 0x7f4c08106f00 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111c90 con 0x7f4c08102780 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0e660640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4c08111f90 con 0x7f4c08101dd0 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39278/0 (socket says 172.21.15.29:39278) 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 -- 172.21.15.29:0/2312188195 learned_addr learned my addr 172.21.15.29:0/2312188195 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c07fff640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c08101dd0 0x7f4c08198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:13.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c077fe640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 0x7f4c081987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 -- 172.21.15.29:0/2312188195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c08101dd0 msgr2=0x7f4c08198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c08101dd0 0x7f4c08198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 -- 172.21.15.29:0/2312188195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 msgr2=0x7f4c081987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 0x7f4c081987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.138+0000 7f4c0cbfd640 1 -- 172.21.15.29:0/2312188195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0819d240 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c077fe640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 0x7f4c081987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c0cbfd640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0819cb60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009dc0 tx=0x7f4c00032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00003cf0 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4c000044f0 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0819d4d0 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00030bf0 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.139+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c081a4e10 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.140+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c081021b0 con 0x7f4c08106f00 2024-09-19T07:08:13.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.141+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4c00004040 con 0x7f4c08106f00 2024-09-19T07:08:13.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.142+0000 7f4c057fa640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4bf00a32d0 0x7f4bf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:13.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.142+0000 7f4c07fff640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4bf00a32d0 0x7f4bf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:13.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.142+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f4c000f1350 con 0x7f4c08106f00 2024-09-19T07:08:13.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.142+0000 7f4c07fff640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4bf00a32d0 0x7f4bf00a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8005fd0 tx=0x7f4bf800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:13.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.146+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c000bdcc0 con 0x7f4c08106f00 2024-09-19T07:08:13.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.362+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4c0810a1a0 con 0x7f4c08106f00 2024-09-19T07:08:13.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.362+0000 7f4c057fa640 1 -- 172.21.15.29:0/2312188195 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4c000bd5c0 con 0x7f4c08106f00 2024-09-19T07:08:13.364 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:13.364 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4bf00a32d0 msgr2=0x7f4bf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4bf00a32d0 0x7f4bf00a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8005fd0 tx=0x7f4bf800b390 comp rx=0 tx=0).stop 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 msgr2=0x7f4c0819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0819cb60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009dc0 tx=0x7f4c00032ff0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 shutdown_connections 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4c08106f00 0x7f4c0819cb60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c08102780 0x7f4c081987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4bf00a32d0 0x7f4bf00a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 --2- 172.21.15.29:0/2312188195 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c08101dd0 0x7f4c08198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:13.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 >> 172.21.15.29:0/2312188195 conn(0x7f4c080fd850 msgr2=0x7f4c080febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:13.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 shutdown_connections 2024-09-19T07:08:13.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:13.364+0000 7f4c0e660640 1 -- 172.21.15.29:0/2312188195 wait complete. 2024-09-19T07:08:13.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:13 smithi078 ceph-mon[34556]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:13.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:13 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2312188195' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:08:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:13 smithi046 ceph-mon[34147]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:13 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2312188195' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:08:14.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:13 smithi029 ceph-mon[31255]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:14.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:13 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2312188195' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:08:14.200 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T07:08:14.200 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:14.458 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:14.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T07:08:14.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:14 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T07:08:14.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T07:08:14.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:14 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T07:08:14.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T07:08:14.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:14 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 -- 172.21.15.29:0/1714025738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 msgr2=0x7f5ba810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/1714025738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba810bbb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009900 tx=0x7f5b9002a480 comp rx=0 tx=0).stop 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 -- 172.21.15.29:0/1714025738 shutdown_connections 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/1714025738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ba810c180 0x7f5ba810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/1714025738 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba810bbb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/1714025738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ba8102da0 0x7f5ba8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.970+0000 7f5bacbb6640 1 -- 172.21.15.29:0/1714025738 >> 172.21.15.29:0/1714025738 conn(0x7f5ba80fc7a0 msgr2=0x7f5ba80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.971+0000 7f5bacbb6640 1 -- 172.21.15.29:0/1714025738 shutdown_connections 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.971+0000 7f5bacbb6640 1 -- 172.21.15.29:0/1714025738 wait complete. 2024-09-19T07:08:15.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.971+0000 7f5bacbb6640 1 Processor -- start 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.971+0000 7f5bacbb6640 1 -- start start 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5bacbb6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ba8102da0 0x7f5ba819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5bacbb6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5bacbb6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ba810c180 0x7f5ba819eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5bacbb6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8111e10 con 0x7f5ba81036c0 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5bacbb6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8111c90 con 0x7f5ba8102da0 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5bacbb6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba8111f90 con 0x7f5ba810c180 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba819ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:39296/0 (socket says 172.21.15.29:39296) 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 -- 172.21.15.29:0/4208943801 learned_addr learned my addr 172.21.15.29:0/4208943801 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5ba659c640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ba8102da0 0x7f5ba819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5ba6d9d640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ba810c180 0x7f5ba819eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:15.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 -- 172.21.15.29:0/4208943801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ba810c180 msgr2=0x7f5ba819eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ba810c180 0x7f5ba819eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 -- 172.21.15.29:0/4208943801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ba8102da0 msgr2=0x7f5ba819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ba8102da0 0x7f5ba819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 -- 172.21.15.29:0/4208943801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba819f580 con 0x7f5ba81036c0 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.972+0000 7f5b9dd9b640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba819ab10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5b90005940 tx=0x7f5b90004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.973+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9003f030 con 0x7f5ba81036c0 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.973+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba819f810 con 0x7f5ba81036c0 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.973+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5b90003aa0 con 0x7f5ba81036c0 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.973+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90035070 con 0x7f5ba81036c0 2024-09-19T07:08:15.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.973+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba81a7150 con 0x7f5ba81036c0 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.974+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba8103180 con 0x7f5ba81036c0 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.975+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5b90042030 con 0x7f5ba81036c0 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.975+0000 7f5b9ffff640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5b940a3240 0x7f5b940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.976+0000 7f5ba659c640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5b940a3240 0x7f5b940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.976+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f5b900f0210 con 0x7f5ba81036c0 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.976+0000 7f5ba659c640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5b940a3240 0x7f5b940a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b98005fd0 tx=0x7f5b9800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:15.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:14.980+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b900bc4f0 con 0x7f5ba81036c0 2024-09-19T07:08:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.193+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ba81a7350 con 0x7f5ba81036c0 2024-09-19T07:08:15.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.194+0000 7f5b9ffff640 1 -- 172.21.15.29:0/4208943801 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7f5b900c07f0 con 0x7f5ba81036c0 2024-09-19T07:08:15.196 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:15.196 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:08:15.196 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5b940a3240 msgr2=0x7f5b940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5b940a3240 0x7f5b940a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b98005fd0 tx=0x7f5b9800b390 comp rx=0 tx=0).stop 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 msgr2=0x7f5ba819ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba819ab10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5b90005940 tx=0x7f5b90004270 comp rx=0 tx=0).stop 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 shutdown_connections 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5b940a3240 0x7f5b940a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ba810c180 0x7f5ba819eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ba81036c0 0x7f5ba819ab10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 --2- 172.21.15.29:0/4208943801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ba8102da0 0x7f5ba819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:15.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 >> 172.21.15.29:0/4208943801 conn(0x7f5ba80fc7a0 msgr2=0x7f5ba8101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:15.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 shutdown_connections 2024-09-19T07:08:15.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:15.196+0000 7f5bacbb6640 1 -- 172.21.15.29:0/4208943801 wait complete. 2024-09-19T07:08:15.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:15 smithi078 ceph-mon[34556]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:15.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T07:08:15.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:15 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T07:08:15.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:15 smithi078 ceph-mon[34556]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T07:08:15.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:15 smithi078 ceph-mon[34556]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:08:15.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:15 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/4208943801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:15 smithi046 ceph-mon[34147]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T07:08:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:15 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T07:08:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:15 smithi046 ceph-mon[34147]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T07:08:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:15 smithi046 ceph-mon[34147]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:08:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:15 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/4208943801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:16.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:15 smithi029 ceph-mon[31255]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:16.122 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T07:08:16.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:15 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T07:08:16.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:15 smithi029 ceph-mon[31255]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T07:08:16.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:15 smithi029 ceph-mon[31255]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:08:16.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:15 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/4208943801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:16.159 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:16.426 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:16.822 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:16 smithi029 ceph-mon[31255]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:08:16.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.902+0000 7f4df71d5640 1 -- 172.21.15.29:0/672458437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0101420 msgr2=0x7f4df010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.902+0000 7f4df71d5640 1 --2- 172.21.15.29:0/672458437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0101420 0x7f4df010d950 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009cd0 tx=0x7f4de802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.902+0000 7f4df71d5640 1 -- 172.21.15.29:0/672458437 shutdown_connections 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.902+0000 7f4df71d5640 1 --2- 172.21.15.29:0/672458437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0101420 0x7f4df010d950 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.902+0000 7f4df71d5640 1 --2- 172.21.15.29:0/672458437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0100a80 0x7f4df0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.902+0000 7f4df71d5640 1 --2- 172.21.15.29:0/672458437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0106a80 0x7f4df0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- 172.21.15.29:0/672458437 >> 172.21.15.29:0/672458437 conn(0x7f4df00fc7a0 msgr2=0x7f4df00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- 172.21.15.29:0/672458437 shutdown_connections 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- 172.21.15.29:0/672458437 wait complete. 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 Processor -- start 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- start start 2024-09-19T07:08:16.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0100a80 0x7f4df01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0101420 0x7f4df0199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 0x7f4df01a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0110d30 con 0x7f4df0106a80 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0110bb0 con 0x7f4df0100a80 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.903+0000 7f4df71d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0110eb0 con 0x7f4df0101420 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 0x7f4df01a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 0x7f4df01a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40746/0 (socket says 172.21.15.29:40746) 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 -- 172.21.15.29:0/422083911 learned_addr learned my addr 172.21.15.29:0/422083911 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df4f71640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0100a80 0x7f4df01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 -- 172.21.15.29:0/422083911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0101420 msgr2=0x7f4df0199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:16.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4deffff640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0101420 0x7f4df0199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0101420 0x7f4df0199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 -- 172.21.15.29:0/422083911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0100a80 msgr2=0x7f4df01991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0100a80 0x7f4df01991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 -- 172.21.15.29:0/422083911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df01a4780 con 0x7f4df0106a80 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df4f71640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0100a80 0x7f4df01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4deffff640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0101420 0x7f4df0199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df5772640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 0x7f4df01a4240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4de8005cc0 tx=0x7f4de8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8004450 con 0x7f4df0106a80 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4de8031c90 con 0x7f4df0106a80 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df01a4950 con 0x7f4df0106a80 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.904+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de803b400 con 0x7f4df0106a80 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.905+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df01a4e30 con 0x7f4df0106a80 2024-09-19T07:08:16.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.906+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df0100ee0 con 0x7f4df0106a80 2024-09-19T07:08:16.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.907+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4de8004680 con 0x7f4df0106a80 2024-09-19T07:08:16.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.907+0000 7f4dedffb640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4dd80a3240 0x7f4dd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:16.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.908+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4de802e030 con 0x7f4df0106a80 2024-09-19T07:08:16.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.908+0000 7f4df4f71640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4dd80a3240 0x7f4dd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:16.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.908+0000 7f4df4f71640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4dd80a3240 0x7f4dd80a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005fd0 tx=0x7f4de0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:16.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:16.912+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4de80bd900 con 0x7f4df0106a80 2024-09-19T07:08:16.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:16 smithi078 ceph-mon[34556]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:08:16.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:16 smithi046 ceph-mon[34147]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:08:17.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.128+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4df0108ff0 con 0x7f4df0106a80 2024-09-19T07:08:17.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.128+0000 7f4dedffb640 1 -- 172.21.15.29:0/422083911 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7f4de80098b0 con 0x7f4df0106a80 2024-09-19T07:08:17.130 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:17.131 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:08:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:08:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4dd80a3240 msgr2=0x7f4dd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4dd80a3240 0x7f4dd80a5700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005fd0 tx=0x7f4de0005850 comp rx=0 tx=0).stop 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 msgr2=0x7f4df01a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 0x7f4df01a4240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4de8005cc0 tx=0x7f4de8003c20 comp rx=0 tx=0).stop 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 shutdown_connections 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4df0106a80 0x7f4df01a4240 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4dd80a3240 0x7f4dd80a5700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df0101420 0x7f4df0199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 --2- 172.21.15.29:0/422083911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df0100a80 0x7f4df01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 >> 172.21.15.29:0/422083911 conn(0x7f4df00fc7a0 msgr2=0x7f4df00fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 shutdown_connections 2024-09-19T07:08:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:17.131+0000 7f4df71d5640 1 -- 172.21.15.29:0/422083911 wait complete. 2024-09-19T07:08:17.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:17 smithi029 ceph-mon[31255]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T07:08:17.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:17 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/422083911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:17.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:17 smithi078 ceph-mon[34556]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T07:08:17.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:17 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/422083911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:17.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:17 smithi046 ceph-mon[34147]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-19T07:08:17.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:17 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/422083911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:18.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:08:18.304 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 -- 172.21.15.29:0/266889936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c106f10 msgr2=0x7fb68c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 --2- 172.21.15.29:0/266889936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c106f10 0x7fb68c10ea90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb684009ca0 tx=0x7fb68402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 -- 172.21.15.29:0/266889936 shutdown_connections 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 --2- 172.21.15.29:0/266889936 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c106f10 0x7fb68c10ea90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 --2- 172.21.15.29:0/266889936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 0x7fb68c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 --2- 172.21.15.29:0/266889936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb68c101de0 0x7fb68c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 -- 172.21.15.29:0/266889936 >> 172.21.15.29:0/266889936 conn(0x7fb68c0fd8c0 msgr2=0x7fb68c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 -- 172.21.15.29:0/266889936 shutdown_connections 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.766+0000 7fb691224640 1 -- 172.21.15.29:0/266889936 wait complete. 2024-09-19T07:08:18.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 Processor -- start 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 -- start start 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 0x7fb68c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 0x7fb68c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb68c106f10 0x7fb68c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c111e40 con 0x7fb68c101de0 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c111cc0 con 0x7fb68c106f10 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb691224640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c111fc0 con 0x7fb68c102790 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb68ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 0x7fb68c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb68ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 0x7fb68c198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40756/0 (socket says 172.21.15.29:40756) 2024-09-19T07:08:18.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb68ad9d640 1 -- 172.21.15.29:0/2848178531 learned_addr learned my addr 172.21.15.29:0/2848178531 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.767+0000 7fb68b59e640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb68c106f10 0x7fb68c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68a59c640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 0x7fb68c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68ad9d640 1 -- 172.21.15.29:0/2848178531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 msgr2=0x7fb68c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68ad9d640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 0x7fb68c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68ad9d640 1 -- 172.21.15.29:0/2848178531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb68c106f10 msgr2=0x7fb68c19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68ad9d640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb68c106f10 0x7fb68c19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68ad9d640 1 -- 172.21.15.29:0/2848178531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c19d3b0 con 0x7fb68c101de0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68a59c640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 0x7fb68c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb68ad9d640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 0x7fb68c198400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c890 tx=0x7fb67c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c004220 con 0x7fb68c101de0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c19d6a0 con 0x7fb68c101de0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb67c0043c0 con 0x7fb68c101de0 2024-09-19T07:08:18.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c004a00 con 0x7fb68c101de0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.768+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c1a4f80 con 0x7fb68c101de0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.769+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68c1021c0 con 0x7fb68c101de0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.770+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb67c004ba0 con 0x7fb68c101de0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.771+0000 7fb673fff640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb6740a3240 0x7fb6740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.771+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb67c0cf960 con 0x7fb68c101de0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.771+0000 7fb68a59c640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb6740a3240 0x7fb6740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.771+0000 7fb68a59c640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb6740a3240 0x7fb6740a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb680006fd0 tx=0x7fb680008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:18.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.775+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb67c014030 con 0x7fb68c101de0 2024-09-19T07:08:18.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.950+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb68c109bc0 con 0x7fb68c101de0 2024-09-19T07:08:18.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.952+0000 7fb673fff640 1 -- 172.21.15.29:0/2848178531 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24747 (secure 0 0 0) 0x7fb67c09c2f0 con 0x7fb68c101de0 2024-09-19T07:08:18.954 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:18.954 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":92,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:08:15.648219+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb6740a3240 msgr2=0x7fb6740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb6740a3240 0x7fb6740a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb680006fd0 tx=0x7fb680008040 comp rx=0 tx=0).stop 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 msgr2=0x7fb68c198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 0x7fb68c198400 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c890 tx=0x7fb67c00cd50 comp rx=0 tx=0).stop 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 shutdown_connections 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb68c106f10 0x7fb68c19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb6740a3240 0x7fb6740a5700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb68c102790 0x7fb68c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 --2- 172.21.15.29:0/2848178531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb68c101de0 0x7fb68c198400 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:18.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 >> 172.21.15.29:0/2848178531 conn(0x7fb68c0fd8c0 msgr2=0x7fb68c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:18.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 shutdown_connections 2024-09-19T07:08:18.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:18.955+0000 7fb691224640 1 -- 172.21.15.29:0/2848178531 wait complete. 2024-09-19T07:08:19.749 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:19.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:19 smithi078 ceph-mon[34556]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T07:08:19.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:19 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2848178531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:19.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:19 smithi046 ceph-mon[34147]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T07:08:19.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:19 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2848178531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:20.010 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:20.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:19 smithi029 ceph-mon[31255]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T07:08:20.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:19 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2848178531' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 -- 172.21.15.29:0/1962225512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754102d90 msgr2=0x7f4754103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 --2- 172.21.15.29:0/1962225512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754102d90 0x7f4754103170 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4744009930 tx=0x7f474402a420 comp rx=0 tx=0).stop 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 -- 172.21.15.29:0/1962225512 shutdown_connections 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 --2- 172.21.15.29:0/1962225512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4754108290 0x7f475410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 --2- 172.21.15.29:0/1962225512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4754103740 0x7f4754107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 --2- 172.21.15.29:0/1962225512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754102d90 0x7f4754103170 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 -- 172.21.15.29:0/1962225512 >> 172.21.15.29:0/1962225512 conn(0x7f47540fc7d0 msgr2=0x7f47540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 -- 172.21.15.29:0/1962225512 shutdown_connections 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 -- 172.21.15.29:0/1962225512 wait complete. 2024-09-19T07:08:20.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.520+0000 7f4759c13640 1 Processor -- start 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 -- start start 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4754102d90 0x7f4754198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4754103740 0x7f4754198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 0x7f475419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4754111f40 con 0x7f4754108290 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4754111dc0 con 0x7f4754102d90 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4759c13640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47541120c0 con 0x7f4754103740 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 0x7f475419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 0x7f475419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40774/0 (socket says 172.21.15.29:40774) 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 -- 172.21.15.29:0/3560572604 learned_addr learned my addr 172.21.15.29:0/3560572604 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f474affd640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4754103740 0x7f4754198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f47537fe640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4754102d90 0x7f4754198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:20.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 -- 172.21.15.29:0/3560572604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4754103740 msgr2=0x7f4754198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4754103740 0x7f4754198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 -- 172.21.15.29:0/3560572604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4754102d90 msgr2=0x7f4754198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.521+0000 7f4753fff640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4754102d90 0x7f4754198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f4753fff640 1 -- 172.21.15.29:0/3560572604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475419d520 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f4753fff640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 0x7f475419ce40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f474c00cad0 tx=0x7f474c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00ae20 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f474c005020 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475419d810 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c00f6b0 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.522+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47541a50f0 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.523+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475406a7f0 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.524+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f474c0051d0 con 0x7f4754108290 2024-09-19T07:08:20.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.525+0000 7f47517fa640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f47400a3240 0x7f47400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.525+0000 7f47537fe640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f47400a3240 0x7f47400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.525+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f474c0cfc10 con 0x7f4754108290 2024-09-19T07:08:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.525+0000 7f47537fe640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f47400a3240 0x7f47400a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4744009900 tx=0x7f4744000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:20.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.529+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f474c014030 con 0x7f4754108290 2024-09-19T07:08:20.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.742+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f475410a2a0 con 0x7f4754108290 2024-09-19T07:08:20.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.743+0000 7f47517fa640 1 -- 172.21.15.29:0/3560572604 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7f474c09bf50 con 0x7f4754108290 2024-09-19T07:08:20.745 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:20.745 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:08:20.745 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:08:20.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.745+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f47400a3240 msgr2=0x7f47400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:20.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f47400a3240 0x7f47400a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4744009900 tx=0x7f4744000bc0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 msgr2=0x7f475419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 0x7f475419ce40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f474c00cad0 tx=0x7f474c00cf90 comp rx=0 tx=0).stop 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 shutdown_connections 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4754108290 0x7f475419ce40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f47400a3240 0x7f47400a5700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4754103740 0x7f4754198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 --2- 172.21.15.29:0/3560572604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4754102d90 0x7f4754198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 >> 172.21.15.29:0/3560572604 conn(0x7f47540fc7d0 msgr2=0x7f4754105ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 shutdown_connections 2024-09-19T07:08:20.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:20.746+0000 7f4759c13640 1 -- 172.21.15.29:0/3560572604 wait complete. 2024-09-19T07:08:21.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:06:25.493071+0000', 'modified': '2024-09-19T07:07:02.814825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/865095783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 865095783}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 865095783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.78:6839/2907917016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6838', 'nonce': 2907917016}, {'type': 'v1', 'addr': '172.21.15.78:6839', 'nonce': 2907917016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24499, 'qdb_cluster': [24499]} 2024-09-19T07:08:21.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T07:08:21.503 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:08:21.766 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:21.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:21 smithi029 ceph-mon[31255]: pgmap v355: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T07:08:21.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:21 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3560572604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:21.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:21 smithi078 ceph-mon[34556]: pgmap v355: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T07:08:21.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:21 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3560572604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:21 smithi046 ceph-mon[34147]: pgmap v355: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 383 B/s wr, 3 op/s 2024-09-19T07:08:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:21 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3560572604' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.282+0000 7f150eb97640 1 -- 172.21.15.29:0/575376867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102570 msgr2=0x7f15081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.282+0000 7f150eb97640 1 --2- 172.21.15.29:0/575376867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102570 0x7f15081029b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009900 tx=0x7f14f802a480 comp rx=0 tx=0).stop 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 -- 172.21.15.29:0/575376867 shutdown_connections 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 --2- 172.21.15.29:0/575376867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1508102ef0 0x7f150810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 --2- 172.21.15.29:0/575376867 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102570 0x7f15081029b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 --2- 172.21.15.29:0/575376867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1508100e20 0x7f1508101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 -- 172.21.15.29:0/575376867 >> 172.21.15.29:0/575376867 conn(0x7f15080fc7d0 msgr2=0x7f15080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 -- 172.21.15.29:0/575376867 shutdown_connections 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 -- 172.21.15.29:0/575376867 wait complete. 2024-09-19T07:08:22.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 Processor -- start 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 -- start start 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1508100e20 0x7f15081983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.283+0000 7f150eb97640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1508102570 0x7f15081988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150eb97640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 0x7f150819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150eb97640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1508110e30 con 0x7f1508102ef0 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150eb97640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1508110cb0 con 0x7f1508102570 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150eb97640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1508110fb0 con 0x7f1508100e20 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 0x7f150819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 0x7f150819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40786/0 (socket says 172.21.15.29:40786) 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 -- 172.21.15.29:0/3091242268 learned_addr learned my addr 172.21.15.29:0/3091242268 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150c933640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1508100e20 0x7f15081983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f1507fff640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1508102570 0x7f15081988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 -- 172.21.15.29:0/3091242268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1508100e20 msgr2=0x7f15081983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1508100e20 0x7f15081983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 -- 172.21.15.29:0/3091242268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1508102570 msgr2=0x7f15081988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1508102570 0x7f15081988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 -- 172.21.15.29:0/3091242268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150819d360 con 0x7f1508102ef0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150d134640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 0x7f150819cc80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f14f000d950 tx=0x7f14f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f1505ffb640 1 -- 172.21.15.29:0/3091242268 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0017030 con 0x7f1508102ef0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150819d650 con 0x7f1508102ef0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f1505ffb640 1 -- 172.21.15.29:0/3091242268 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14f0004020 con 0x7f1508102ef0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.284+0000 7f1505ffb640 1 -- 172.21.15.29:0/3091242268 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0003b20 con 0x7f1508102ef0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.285+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15081a4f30 con 0x7f1508102ef0 2024-09-19T07:08:22.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1505ffb640 1 -- 172.21.15.29:0/3091242268 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f14f001a070 con 0x7f1508102ef0 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 Processor -- start 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 -- start start 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e072db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 0x555e3e07d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e07dbb0 0x555e3e07ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3dfd9090 con 0x555e3e0732f0 2024-09-19T07:08:22.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555e3df80a70 con 0x555e3e07dbb0 2024-09-19T07:08:22.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.287+0000 7f1510f70740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555e3dfd5050 con 0x555e3e0729d0 2024-09-19T07:08:22.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 0x555e3e07d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 0x555e3e07d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40788/0 (socket says 172.21.15.29:40788) 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 -- 172.21.15.29:0/3625737548 learned_addr learned my addr 172.21.15.29:0/3625737548 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f1507fff640 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f1505ffb640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f14f40a3240 0x7f14f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f1507fff640 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e07dbb0 0x555e3e07ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 -- 172.21.15.29:0/3625737548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 msgr2=0x555e3e072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e072db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 -- 172.21.15.29:0/3625737548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e07dbb0 msgr2=0x555e3e07ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e07dbb0 0x555e3e07ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 -- 172.21.15.29:0/3625737548 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3df8d130 con 0x555e3e0732f0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f1507fff640 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150d134640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f14f40a3240 0x7f14f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f1505ffb640 1 -- 172.21.15.29:0/3091242268 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f14f00cf440 con 0x7f1508102ef0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f150c933640 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 0x555e3e07d670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1500007f90 tx=0x7f150000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23248e885d8172a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f14feffd640 1 -- 172.21.15.29:0/3625737548 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500004d20 con 0x555e3e0732f0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f14feffd640 1 -- 172.21.15.29:0/3625737548 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1500010bb0 con 0x555e3e0732f0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.288+0000 7f14feffd640 1 -- 172.21.15.29:0/3625737548 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000056b0 con 0x555e3e0732f0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 -- 172.21.15.29:0/3625737548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 msgr2=0x555e3e07d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 0x555e3e07d670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1500007f90 tx=0x7f150000f850 comp rx=0 tx=0).stop 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f150d134640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f14f40a3240 0x7f14f40a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14f009b3d0 tx=0x7f14f006d4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 -- 172.21.15.29:0/3625737548 shutdown_connections 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e07dbb0 0x555e3e07ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e0732f0 0x555e3e07d670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 --2- 172.21.15.29:0/3625737548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 -- 172.21.15.29:0/3625737548 >> 172.21.15.29:0/3625737548 conn(0x555e3e06ef60 msgr2=0x555e3e06f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 -- 172.21.15.29:0/3625737548 shutdown_connections 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.289+0000 7f1510f70740 1 -- 172.21.15.29:0/3625737548 wait complete. 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 -- start start 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 Processor -- start 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e07d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e07a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e07ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3e080780 con 0x555e3e07dbb0 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555e3df93f20 con 0x555e3e0732f0 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555e3e080900 con 0x555e3e0729d0 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1510f70740 10 client.0 _ll_register_callbacks cb 0x555e3df5d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:08:22.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e07ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e07ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40794/0 (socket says 172.21.15.29:40794) 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 -- 172.21.15.29:0/180186518 learned_addr learned my addr 172.21.15.29:0/180186518 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f150c933640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e07a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 -- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 msgr2=0x555e3e07d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e07d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 -- 172.21.15.29:0/180186518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 msgr2=0x555e3e07a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e07a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f1507fff640 1 -- 172.21.15.29:0/180186518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3dd4a2b0 con 0x555e3e07dbb0 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.290+0000 7f150c933640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e07a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f1507fff640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e07ac20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009900 tx=0x7f14f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6f1ba57d466d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f14e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-19T07:08:22.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f14e7fff640 1 -- 172.21.15.29:0/180186518 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8035070 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f14e7fff640 1 -- 172.21.15.29:0/180186518 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f14f8004230 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1500010bb0 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f14e7fff640 1 -- 172.21.15.29:0/180186518 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f14f8004430 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f1510f70740 10 client.15084 fetch_fsmap learned FSMap version 20 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555e3e08bfe0 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f14e7fff640 1 -- 172.21.15.29:0/180186518 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1500010bb0 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f14e7fff640 1 -- 172.21.15.29:0/180186518 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f14f803d610 con 0x555e3e07dbb0 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.291+0000 7f1510f70740 10 client.15084 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f1510f70740 10 client.15084 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f1510f70740 20 client.15084 populate_metadata read hostname 'smithi029' 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f1510f70740 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e08e680 0x555e3e08faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f1510f70740 4 client.15084 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:08:22.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 --> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e3dfe6600 con 0x555e3e08e680 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f150c933640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e08e680 0x555e3e08faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f14e7fff640 10 client.15084 ms_handle_connect on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.292+0000 7f150c933640 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e08e680 0x555e3e08faf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=783db6bcd65b4d37 server_cookie=c6d1b9414a6f2c37 in_seq=0 out_seq=0 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f14e7fff640 1 -- 172.21.15.29:0/180186518 <== mds.0 v2:172.21.15.78:6838/2907917016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e3dfe6600 con 0x555e3e08e680 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f14e7fff640 10 client.15084 handle_command_reply: tid=0 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 client.15084 shutdown 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 msgr2=0x555e3e07ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e07ac20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009900 tx=0x7f14f8009260 comp rx=0 tx=0).stop 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 shutdown_connections 2024-09-19T07:08:22.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e08e680 0x555e3e08faf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e07ac20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e07a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 --2- 172.21.15.29:0/180186518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e07d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f14e7fff640 0 client.15084 ms_handle_reset on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.293+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 >> 172.21.15.29:0/180186518 conn(0x555e3e06ef60 msgr2=0x555e3e074c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.294+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 shutdown_connections 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.294+0000 7f1510f70740 1 -- 172.21.15.29:0/180186518 wait complete. 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.294+0000 7f1510f70740 20 client.15084 trim_cache size 0 max 16384 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.311+0000 7f1510f70740 1 Processor -- start 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.311+0000 7f1510f70740 1 -- start start 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1510f70740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e08dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1510f70740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e08ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1510f70740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e0981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1510f70740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3e08de30 con 0x555e3e07dbb0 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1510f70740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555e3e08e500 con 0x555e3e0732f0 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1510f70740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555e3e08ebd0 con 0x555e3e0729d0 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e0981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e0981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40806/0 (socket says 172.21.15.29:40806) 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 -- 172.21.15.29:0/3697484066 learned_addr learned my addr 172.21.15.29:0/3697484066 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 -- 172.21.15.29:0/3697484066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 msgr2=0x555e3e08dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e08dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 -- 172.21.15.29:0/3697484066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 msgr2=0x555e3e08ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f150c933640 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e08ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e08ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 -- 172.21.15.29:0/3697484066 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e3e07cfb0 con 0x555e3e07dbb0 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f150c933640 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e08ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f1507fff640 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e0981c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009850 tx=0x7f14f8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24e8b173be505fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f14fe7fc640 1 -- 172.21.15.29:0/3697484066 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f805b070 con 0x555e3e07dbb0 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.312+0000 7f14fe7fc640 1 -- 172.21.15.29:0/3697484066 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14f8031980 con 0x555e3e07dbb0 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f14fe7fc640 1 -- 172.21.15.29:0/3697484066 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8035070 con 0x555e3e07dbb0 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 -- 172.21.15.29:0/3697484066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 msgr2=0x555e3e0981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e0981c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009850 tx=0x7f14f8001e70 comp rx=0 tx=0).stop 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 -- 172.21.15.29:0/3697484066 shutdown_connections 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e0981c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0732f0 0x555e3e08ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 --2- 172.21.15.29:0/3697484066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0729d0 0x555e3e08dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 -- 172.21.15.29:0/3697484066 >> 172.21.15.29:0/3697484066 conn(0x555e3e06ef60 msgr2=0x555e3e069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 -- 172.21.15.29:0/3697484066 shutdown_connections 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 -- 172.21.15.29:0/3697484066 wait complete. 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.313+0000 7f1510f70740 1 -- start start 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 Processor -- start 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0729d0 0x555e3e098100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0732f0 0x555e3e098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e095630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x555e3e08f970 con 0x555e3e07dbb0 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555e3e08f2a0 con 0x555e3e0729d0 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555e3e090040 con 0x555e3e0732f0 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1510f70740 10 client.0 _ll_register_callbacks cb 0x7f14f8032ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e095630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e095630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40820/0 (socket says 172.21.15.29:40820) 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 -- 172.21.15.29:0/1528351766 learned_addr learned my addr 172.21.15.29:0/1528351766 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0729d0 0x555e3e098100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f150c933640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0732f0 0x555e3e098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 -- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0732f0 msgr2=0x555e3e098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0732f0 0x555e3e098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 -- 172.21.15.29:0/1528351766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0729d0 msgr2=0x555e3e098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0729d0 0x555e3e098100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.314+0000 7f1507fff640 1 -- 172.21.15.29:0/1528351766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e3e095e60 con 0x555e3e07dbb0 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "6a046fca-7654-11ef-bceb-c7b262605968", 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24499, 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 116.51737591200001, 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 20, 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 92, 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 88, 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 136.96024506500001 2024-09-19T07:08:22.336 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T07:08:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1507fff640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e095630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009900 tx=0x7f14f8031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538dba31ad42d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:22.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f14e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f14e7fff640 1 -- 172.21.15.29:0/1528351766 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f805b070 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f14e7fff640 1 -- 172.21.15.29:0/1528351766 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f14f8031b30 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14f8031980 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f14e7fff640 1 -- 172.21.15.29:0/1528351766 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f14f8071050 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 10 client.15090 fetch_fsmap learned FSMap version 20 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x555e3e0fc930 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f14e7fff640 1 -- 172.21.15.29:0/1528351766 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14f8031980 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f14e7fff640 1 -- 172.21.15.29:0/1528351766 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f14f8048430 con 0x555e3e07dbb0 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 10 client.15090 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 20 client.15090 populate_metadata read hostname 'smithi029' 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e1010f0 0x555e3e0ffe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:22.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 4 client.15090 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.315+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 --> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] -- command(tid 0: {"prefix": "status"}) -- 0x555e3dfe0b10 con 0x555e3e1010f0 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f150c933640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e1010f0 0x555e3e0ffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f150c933640 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e1010f0 0x555e3e0ffe00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18962c1573f81996 server_cookie=3785ab9bf3752b58 in_seq=0 out_seq=0 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f14e7fff640 10 client.15090 ms_handle_connect on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f14e7fff640 1 -- 172.21.15.29:0/1528351766 <== mds.0 v2:172.21.15.78:6838/2907917016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555e3dfe0b10 con 0x555e3e1010f0 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f14e7fff640 10 client.15090 handle_command_reply: tid=0 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 client.15090 shutdown 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 msgr2=0x555e3e095630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e095630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f14f8009900 tx=0x7f14f8031640 comp rx=0 tx=0).stop 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 shutdown_connections 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x555e3e1010f0 0x555e3e0ffe00 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x555e3e07dbb0 0x555e3e095630 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555e3e0732f0 0x555e3e098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 --2- 172.21.15.29:0/1528351766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555e3e0729d0 0x555e3e098100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.316+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 >> 172.21.15.29:0/1528351766 conn(0x555e3e06ef60 msgr2=0x555e3e07a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f14e7fff640 0 client.15090 ms_handle_reset on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 shutdown_connections 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f1510f70740 1 -- 172.21.15.29:0/1528351766 wait complete. 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f1510f70740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f14f40a3240 msgr2=0x7f14f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f150eb97640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f14f40a3240 0x7f14f40a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14f009b3d0 tx=0x7f14f006d4a0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 msgr2=0x7f150819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.317+0000 7f150eb97640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 0x7f150819cc80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f14f000d950 tx=0x7f14f000de10 comp rx=0 tx=0).stop 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 shutdown_connections 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1508102ef0 0x7f150819cc80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1508102570 0x7f15081988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f14f40a3240 0x7f14f40a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 --2- 172.21.15.29:0/3091242268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1508100e20 0x7f15081983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 >> 172.21.15.29:0/3091242268 conn(0x7f15080fc7d0 msgr2=0x7f1508069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 shutdown_connections 2024-09-19T07:08:22.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:22.318+0000 7f150eb97640 1 -- 172.21.15.29:0/3091242268 wait complete. 2024-09-19T07:08:23.151 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T07:08:23.151 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:08:23.162 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T07:08:23.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T07:08:23.427 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:23.840 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:23 smithi029 ceph-mon[31255]: pgmap v356: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-19T07:08:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 -- 172.21.15.29:0/2297387356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80101770 msgr2=0x7fde80101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 --2- 172.21.15.29:0/2297387356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80101770 0x7fde80101c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fde78009ca0 tx=0x7fde7802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 -- 172.21.15.29:0/2297387356 shutdown_connections 2024-09-19T07:08:23.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 --2- 172.21.15.29:0/2297387356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80101770 0x7fde80101c20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 --2- 172.21.15.29:0/2297387356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80100dd0 0x7fde80101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 --2- 172.21.15.29:0/2297387356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde80100490 0x7fde80100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 -- 172.21.15.29:0/2297387356 >> 172.21.15.29:0/2297387356 conn(0x7fde800fc2a0 msgr2=0x7fde800fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 -- 172.21.15.29:0/2297387356 shutdown_connections 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.922+0000 7fde87da6640 1 -- 172.21.15.29:0/2297387356 wait complete. 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 Processor -- start 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 -- start start 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 0x7fde80199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde80100dd0 0x7fde8019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80101770 0x7fde801a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010f910 con 0x7fde80100490 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010f790 con 0x7fde80101770 2024-09-19T07:08:23.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde87da6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fde8010fa90 con 0x7fde80100dd0 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde85b42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 0x7fde80199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde85b42640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 0x7fde80199f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:40840/0 (socket says 172.21.15.29:40840) 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde85b42640 1 -- 172.21.15.29:0/1629297975 learned_addr learned my addr 172.21.15.29:0/1629297975 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.923+0000 7fde86343640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80101770 0x7fde801a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85b42640 1 -- 172.21.15.29:0/1629297975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde80100dd0 msgr2=0x7fde8019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85341640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde80100dd0 0x7fde8019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85b42640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde80100dd0 0x7fde8019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85b42640 1 -- 172.21.15.29:0/1629297975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80101770 msgr2=0x7fde801a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85b42640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80101770 0x7fde801a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85b42640 1 -- 172.21.15.29:0/1629297975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde801a1b60 con 0x7fde80100490 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde86343640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80101770 0x7fde801a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:23.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde85b42640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 0x7fde80199f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c920 tx=0x7fde7c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c007c70 con 0x7fde80100490 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fde7c007e10 con 0x7fde80100490 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde801a1e50 con 0x7fde80100490 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c018820 con 0x7fde80100490 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.924+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801a2300 con 0x7fde80100490 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.925+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8010b1e0 con 0x7fde80100490 2024-09-19T07:08:23.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.926+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fde7c0189c0 con 0x7fde80100490 2024-09-19T07:08:23.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.927+0000 7fde76ffd640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fde6c0a32f0 0x7fde6c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:23.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.927+0000 7fde85341640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fde6c0a32f0 0x7fde6c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:23.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.927+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fde7c0cfe60 con 0x7fde80100490 2024-09-19T07:08:23.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.928+0000 7fde85341640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fde6c0a32f0 0x7fde6c0a57b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fde70005fd0 tx=0x7fde70005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:23.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:23.931+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde7c014030 con 0x7fde80100490 2024-09-19T07:08:23.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:23 smithi078 ceph-mon[34556]: pgmap v356: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-19T07:08:23.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:23 smithi046 ceph-mon[34147]: pgmap v356: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-19T07:08:24.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.125+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fde80062630 con 0x7fde6c0a32f0 2024-09-19T07:08:24.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.126+0000 7fde76ffd640 1 -- 172.21.15.29:0/1629297975 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fde80062630 con 0x7fde6c0a32f0 2024-09-19T07:08:24.126 INFO:teuthology.orchestra.run.smithi029.stdout:Backend: cephadm 2024-09-19T07:08:24.127 INFO:teuthology.orchestra.run.smithi029.stdout:Available: Yes 2024-09-19T07:08:24.127 INFO:teuthology.orchestra.run.smithi029.stdout:Paused: No 2024-09-19T07:08:24.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fde6c0a32f0 msgr2=0x7fde6c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:24.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fde6c0a32f0 0x7fde6c0a57b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fde70005fd0 tx=0x7fde70005850 comp rx=0 tx=0).stop 2024-09-19T07:08:24.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 msgr2=0x7fde80199f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 0x7fde80199f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00c920 tx=0x7fde7c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 shutdown_connections 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde80101770 0x7fde801a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fde6c0a32f0 0x7fde6c0a57b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde80100dd0 0x7fde8019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 --2- 172.21.15.29:0/1629297975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde80100490 0x7fde80199f30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 >> 172.21.15.29:0/1629297975 conn(0x7fde800fc2a0 msgr2=0x7fde800fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 shutdown_connections 2024-09-19T07:08:24.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:24.128+0000 7fde87da6640 1 -- 172.21.15.29:0/1629297975 wait complete. 2024-09-19T07:08:24.866 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T07:08:25.128 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:25.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 -- 172.21.15.29:0/2380760117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 msgr2=0x7f7ad01002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/2380760117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad01002d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009930 tx=0x7f7ac002a420 comp rx=0 tx=0).stop 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 -- 172.21.15.29:0/2380760117 shutdown_connections 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/2380760117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad0103870 0x7f7ad010a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/2380760117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad0102eb0 0x7f7ad0103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/2380760117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad01002d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 -- 172.21.15.29:0/2380760117 >> 172.21.15.29:0/2380760117 conn(0x7f7ad00fba40 msgr2=0x7f7ad00fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 -- 172.21.15.29:0/2380760117 shutdown_connections 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.584+0000 7f7ad52dd640 1 -- 172.21.15.29:0/2380760117 wait complete. 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 Processor -- start 2024-09-19T07:08:25.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 -- start start 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad0197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad0102eb0 0x7f7ad0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad0103870 0x7f7ad019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad010d760 con 0x7f7ad00ffed0 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad010d5e0 con 0x7f7ad0103870 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ad52dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad010d8e0 con 0x7f7ad0102eb0 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad0197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad0197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34774/0 (socket says 172.21.15.29:34774) 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 -- 172.21.15.29:0/737081312 learned_addr learned my addr 172.21.15.29:0/737081312 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7ace7fc640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad0102eb0 0x7f7ad0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:25.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7acf7fe640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad0103870 0x7f7ad019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 -- 172.21.15.29:0/737081312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad0102eb0 msgr2=0x7f7ad0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad0102eb0 0x7f7ad0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 -- 172.21.15.29:0/737081312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad0103870 msgr2=0x7f7ad019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad0103870 0x7f7ad019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.585+0000 7f7aceffd640 1 -- 172.21.15.29:0/737081312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad019fb40 con 0x7f7ad00ffed0 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.586+0000 7f7aceffd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad0197f10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00314e0 tx=0x7f7ac0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.586+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac003f030 con 0x7f7ad00ffed0 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.586+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad019fdd0 con 0x7f7ad00ffed0 2024-09-19T07:08:25.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.586+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ac0003cb0 con 0x7f7ad00ffed0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.586+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0035070 con 0x7f7ad00ffed0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.586+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad0100ca0 con 0x7f7ad00ffed0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.587+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad0109290 con 0x7f7ad00ffed0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.588+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7ac0042030 con 0x7f7ad00ffed0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.589+0000 7f7ab7fff640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7ab80a7680 0x7f7ab80a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.589+0000 7f7ace7fc640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7ab80a7680 0x7f7ab80a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.589+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7ac00efe60 con 0x7f7ad00ffed0 2024-09-19T07:08:25.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.589+0000 7f7ace7fc640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7ab80a7680 0x7f7ab80a9b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0199430 tx=0x7f7ac400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:25.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.593+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ac00bc140 con 0x7f7ad00ffed0 2024-09-19T07:08:25.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.787+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7ad0062630 con 0x7f7ab80a7680 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.800+0000 7f7ab7fff640 1 -- 172.21.15.29:0/737081312 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7f7ad0062630 con 0x7f7ab80a7680 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.a smithi029 running (2m) 61s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 b39e59c34ce6 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.b smithi046 running (2m) 63s ago 2m 18.9M - 19.1.1-361-g2f599a46 d2baa855c067 82e462d0dd6a 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.c smithi078 running (2m) 63s ago 2m 15.7M - 19.1.1-361-g2f599a46 d2baa855c067 e501614f8839 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.d smithi029 running (2m) 61s ago 2m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 a662b06beb8d 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.e smithi046 running (2m) 63s ago 2m 16.8M - 19.1.1-361-g2f599a46 d2baa855c067 62571f68296a 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.f smithi078 running (2m) 63s ago 2m 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 c117347196f4 2024-09-19T07:08:25.801 INFO:teuthology.orchestra.run.smithi029.stdout:mds.g smithi029 running (2m) 61s ago 2m 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 31e3e9258d65 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mds.h smithi046 running (2m) 63s ago 2m 13.3M - 19.1.1-361-g2f599a46 d2baa855c067 9718e73b2eaf 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mds.i smithi078 running (2m) 63s ago 2m 26.4M - 19.1.1-361-g2f599a46 d2baa855c067 0b9f4cc07f7d 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mds.j smithi029 running (2m) 61s ago 2m 16.0M - 19.1.1-361-g2f599a46 d2baa855c067 5c3613ca38cb 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mds.k smithi046 running (2m) 63s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 74e5726e7fbc 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mds.l smithi078 running (2m) 63s ago 2m 15.6M - 19.1.1-361-g2f599a46 d2baa855c067 3943bc697b52 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.x smithi029 *:9283,8765 running (9m) 61s ago 9m 509M - 19.1.1-361-g2f599a46 d2baa855c067 0c441debf022 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.y smithi046 *:8443,8765 running (8m) 63s ago 8m 442M - 19.1.1-361-g2f599a46 d2baa855c067 6432a7a6206a 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mgr.z smithi078 *:8443,8765 running (8m) 63s ago 8m 444M - 19.1.1-361-g2f599a46 d2baa855c067 7c2cf35a47b3 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mon.a smithi029 running (9m) 61s ago 10m 51.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ac4d29aa5733 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mon.b smithi046 running (8m) 63s ago 8m 40.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 424df4c342da 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:mon.c smithi078 running (8m) 63s ago 8m 43.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 12de75059fc1 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 smithi029 running (7m) 61s ago 7m 45.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 5ec009f7abbf 2024-09-19T07:08:25.802 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 smithi046 running (7m) 63s ago 7m 55.2M 4273M 19.1.1-361-g2f599a46 d2baa855c067 be241a66afb4 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 smithi078 running (6m) 63s ago 6m 55.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 06f300a56264 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 smithi029 running (6m) 61s ago 6m 53.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 4a0313daa2d9 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 smithi046 running (6m) 63s ago 6m 50.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3736c108ea48 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 smithi078 running (5m) 63s ago 5m 56.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 2a163b7d2917 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 smithi029 running (5m) 61s ago 5m 45.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 737b641ff8d9 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 smithi046 running (4m) 63s ago 4m 53.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 acf459efaf97 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.8 smithi078 running (4m) 63s ago 4m 52.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dbd5030dfad4 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.9 smithi029 running (3m) 61s ago 3m 42.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 e39dcf60de18 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.10 smithi046 running (3m) 63s ago 3m 45.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3dce432965ee 2024-09-19T07:08:25.803 INFO:teuthology.orchestra.run.smithi029.stdout:osd.11 smithi078 running (3m) 63s ago 3m 47.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dd0ca43d5d08 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7ab80a7680 msgr2=0x7f7ab80a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7ab80a7680 0x7f7ab80a9b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0199430 tx=0x7f7ac400a250 comp rx=0 tx=0).stop 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 msgr2=0x7f7ad0197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad0197f10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00314e0 tx=0x7f7ac0004270 comp rx=0 tx=0).stop 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 shutdown_connections 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ad0103870 0x7f7ad019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7ab80a7680 0x7f7ab80a9b40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ad0102eb0 0x7f7ad0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 --2- 172.21.15.29:0/737081312 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad00ffed0 0x7f7ad0197f10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:25.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.802+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 >> 172.21.15.29:0/737081312 conn(0x7f7ad00fba40 msgr2=0x7f7ad0106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:25.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.803+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 shutdown_connections 2024-09-19T07:08:25.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:25.803+0000 7f7ad52dd640 1 -- 172.21.15.29:0/737081312 wait complete. 2024-09-19T07:08:25.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:25 smithi078 ceph-mon[34556]: pgmap v357: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 333 B/s wr, 2 op/s 2024-09-19T07:08:25.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:25 smithi078 ceph-mon[34556]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:25.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:25 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:25.959 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:25 smithi046 ceph-mon[34147]: pgmap v357: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 333 B/s wr, 2 op/s 2024-09-19T07:08:25.960 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:25 smithi046 ceph-mon[34147]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:25.960 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:25 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:26.018 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:25 smithi029 ceph-mon[31255]: pgmap v357: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 333 B/s wr, 2 op/s 2024-09-19T07:08:26.018 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:25 smithi029 ceph-mon[31255]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:26.018 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:25 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:26.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:26 smithi078 ceph-mon[34556]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:26.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:26.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:26 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:26.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:26 smithi046 ceph-mon[34147]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:26.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:26.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:26 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.097 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:26 smithi029 ceph-mon[31255]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:27.097 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.097 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:26 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.225 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T07:08:27.518 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:27 smithi078 ceph-mon[34556]: pgmap v358: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 300 B/s wr, 2 op/s 2024-09-19T07:08:27.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:27 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:27 smithi029 ceph-mon[31255]: pgmap v358: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 300 B/s wr, 2 op/s 2024-09-19T07:08:27.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.955 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:27 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:27 smithi046 ceph-mon[34147]: pgmap v358: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 300 B/s wr, 2 op/s 2024-09-19T07:08:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:27 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:28.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.040+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4290609327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8102660 msgr2=0x7f29e8104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:28.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.040+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4290609327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8102660 0x7f29e8104a50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009900 tx=0x7f29e402a410 comp rx=0 tx=0).stop 2024-09-19T07:08:28.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.040+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4290609327 shutdown_connections 2024-09-19T07:08:28.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.040+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4290609327 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e81078c0 0x7f29e8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.040+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4290609327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29e8104f90 0x7f29e8107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.040+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4290609327 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8102660 0x7f29e8104a50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4290609327 >> 172.21.15.29:0/4290609327 conn(0x7f29e80fc280 msgr2=0x7f29e80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4290609327 shutdown_connections 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4290609327 wait complete. 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 Processor -- start 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 -- start start 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e8102660 0x7f29e8197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 0x7f29e8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29e81078c0 0x7f29e819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.041+0000 7f29ef9a3640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f29e810d740 con 0x7f29e8104f90 2024-09-19T07:08:28.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ef9a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f29e810d5c0 con 0x7f29e81078c0 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ef9a3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f29e810d8c0 con 0x7f29e8102660 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 0x7f29e8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 0x7f29e8198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34792/0 (socket says 172.21.15.29:34792) 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 -- 172.21.15.29:0/4023494902 learned_addr learned my addr 172.21.15.29:0/4023494902 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ed73f640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e8102660 0x7f29e8197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29edf40640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29e81078c0 0x7f29e819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 -- 172.21.15.29:0/4023494902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e8102660 msgr2=0x7f29e8197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:28.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e8102660 0x7f29e8197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 -- 172.21.15.29:0/4023494902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29e81078c0 msgr2=0x7f29e819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29e81078c0 0x7f29e819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 -- 172.21.15.29:0/4023494902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e819f9f0 con 0x7f29e8104f90 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ecf3e640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 0x7f29e8198300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c970 tx=0x7f29d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8014070 con 0x7f29e8104f90 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29d8004440 con 0x7f29e8104f90 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e819fce0 con 0x7f29e8104f90 2024-09-19T07:08:28.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8003e50 con 0x7f29e8104f90 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.042+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e81a01c0 con 0x7f29e8104f90 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.044+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e80fdd70 con 0x7f29e8104f90 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.045+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f29d8017070 con 0x7f29e8104f90 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.045+0000 7f29de7fc640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29d40a3410 0x7f29d40a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.046+0000 7f29ed73f640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29d40a3410 0x7f29d40a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.046+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f29d80cf860 con 0x7f29e8104f90 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.046+0000 7f29ed73f640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29d40a3410 0x7f29d40a58d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f29e4006010 tx=0x7f29e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:28.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.050+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29d801e030 con 0x7f29e8104f90 2024-09-19T07:08:28.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.272+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f29e8062630 con 0x7f29d40a3410 2024-09-19T07:08:28.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.279+0000 7f29de7fc640 1 -- 172.21.15.29:0/4023494902 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f29e8062630 con 0x7f29d40a3410 2024-09-19T07:08:28.280 INFO:teuthology.orchestra.run.smithi029.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T07:08:28.280 INFO:teuthology.orchestra.run.smithi029.stdout:mds.all 12/12 1s ago 2m smithi029=a;smithi029=d;smithi029=g;smithi029=j;smithi046=b;smithi046=e;smithi046=h;smithi046=k;smithi078=c;smithi078=f;smithi078=i;smithi078=l;count:12 2024-09-19T07:08:28.280 INFO:teuthology.orchestra.run.smithi029.stdout:mgr 3/3 1s ago 8m smithi029=x;smithi046=y;smithi078=z;count:3 2024-09-19T07:08:28.280 INFO:teuthology.orchestra.run.smithi029.stdout:mon 3/3 1s ago 8m smithi029:172.21.15.29=a;smithi046:172.21.15.46=b;smithi078:172.21.15.78=c;count:3 2024-09-19T07:08:28.280 INFO:teuthology.orchestra.run.smithi029.stdout:osd 12 1s ago - 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29d40a3410 msgr2=0x7f29d40a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29d40a3410 0x7f29d40a58d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f29e4006010 tx=0x7f29e4000bc0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 msgr2=0x7f29e8198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 0x7f29e8198300 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c970 tx=0x7f29d800ce30 comp rx=0 tx=0).stop 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 shutdown_connections 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29e81078c0 0x7f29e819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f29e8104f90 0x7f29e8198300 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f29d40a3410 0x7f29d40a58d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 --2- 172.21.15.29:0/4023494902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29e8102660 0x7f29e8197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:28.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.281+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 >> 172.21.15.29:0/4023494902 conn(0x7f29e80fc280 msgr2=0x7f29e81030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:28.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.282+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 shutdown_connections 2024-09-19T07:08:28.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:28.282+0000 7f29ef9a3640 1 -- 172.21.15.29:0/4023494902 wait complete. 2024-09-19T07:08:29.036 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T07:08:29.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T07:08:29.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.633 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T07:08:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:29.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: pgmap v359: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T07:08:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:29.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:29.726 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:08:30.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 -- 172.21.15.29:0/2909536364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70104ff0 msgr2=0x7fdb701073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:30.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2909536364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70104ff0 0x7fdb701073e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009900 tx=0x7fdb5802a410 comp rx=0 tx=0).stop 2024-09-19T07:08:30.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 -- 172.21.15.29:0/2909536364 shutdown_connections 2024-09-19T07:08:30.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2909536364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb70107920 0x7fdb70109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2909536364 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70104ff0 0x7fdb701073e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2909536364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb701026c0 0x7fdb70104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 -- 172.21.15.29:0/2909536364 >> 172.21.15.29:0/2909536364 conn(0x7fdb700fc280 msgr2=0x7fdb700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:30.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 -- 172.21.15.29:0/2909536364 shutdown_connections 2024-09-19T07:08:30.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 -- 172.21.15.29:0/2909536364 wait complete. 2024-09-19T07:08:30.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.119+0000 7fdb754a2640 1 Processor -- start 2024-09-19T07:08:30.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 -- start start 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb701026c0 0x7fdb7019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb70104ff0 0x7fdb7019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 0x7fdb701a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d700 con 0x7fdb70107920 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d580 con 0x7fdb70104ff0 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb754a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010d880 con 0x7fdb701026c0 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 0x7fdb701a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 0x7fdb701a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34814/0 (socket says 172.21.15.29:34814) 2024-09-19T07:08:30.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 -- 172.21.15.29:0/2678287556 learned_addr learned my addr 172.21.15.29:0/2678287556 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6e7fc640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb70104ff0 0x7fdb7019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6effd640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb701026c0 0x7fdb7019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 -- 172.21.15.29:0/2678287556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb701026c0 msgr2=0x7fdb7019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb701026c0 0x7fdb7019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 -- 172.21.15.29:0/2678287556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb70104ff0 msgr2=0x7fdb7019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb70104ff0 0x7fdb7019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 -- 172.21.15.29:0/2678287556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb701a1c60 con 0x7fdb70107920 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.120+0000 7fdb6f7fe640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 0x7fdb701a15f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800d750 tx=0x7fdb6800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.121+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68017070 con 0x7fdb70107920 2024-09-19T07:08:30.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.121+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdb680054d0 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.121+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701a1f50 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.121+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68004c60 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.121+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a2400 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.122+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70109410 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.123+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdb68004e00 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.123+0000 7fdb67fff640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3270 0x7fdb5c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.124+0000 7fdb6effd640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3270 0x7fdb5c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.124+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fdb680cf550 con 0x7fdb70107920 2024-09-19T07:08:30.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.124+0000 7fdb6effd640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3270 0x7fdb5c0a5730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb60005c40 tx=0x7fdb6000a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:30.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.128+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb6809b890 con 0x7fdb70107920 2024-09-19T07:08:30.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.311+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fdb70062630 con 0x7fdb5c0a3270 2024-09-19T07:08:30.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.312+0000 7fdb67fff640 1 -- 172.21.15.29:0/2678287556 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7fdb70062630 con 0x7fdb5c0a3270 2024-09-19T07:08:30.313 INFO:teuthology.orchestra.run.smithi029.stdout:HOST ADDR LABELS STATUS 2024-09-19T07:08:30.313 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029 172.21.15.29 2024-09-19T07:08:30.313 INFO:teuthology.orchestra.run.smithi029.stdout:smithi046 172.21.15.46 2024-09-19T07:08:30.313 INFO:teuthology.orchestra.run.smithi029.stdout:smithi078 172.21.15.78 2024-09-19T07:08:30.313 INFO:teuthology.orchestra.run.smithi029.stdout:3 hosts in cluster 2024-09-19T07:08:30.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3270 msgr2=0x7fdb5c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3270 0x7fdb5c0a5730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb60005c40 tx=0x7fdb6000a590 comp rx=0 tx=0).stop 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 msgr2=0x7fdb701a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 0x7fdb701a15f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800d750 tx=0x7fdb6800dc10 comp rx=0 tx=0).stop 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 shutdown_connections 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb70107920 0x7fdb701a15f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb70104ff0 0x7fdb7019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fdb5c0a3270 0x7fdb5c0a5730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 --2- 172.21.15.29:0/2678287556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb701026c0 0x7fdb7019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 >> 172.21.15.29:0/2678287556 conn(0x7fdb700fc280 msgr2=0x7fdb70101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 shutdown_connections 2024-09-19T07:08:30.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:30.315+0000 7fdb754a2640 1 -- 172.21.15.29:0/2678287556 wait complete. 2024-09-19T07:08:31.107 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T07:08:31.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:31 smithi029 ceph-mon[31255]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:31.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:31 smithi029 ceph-mon[31255]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:31.417 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:31 smithi078 ceph-mon[34556]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:31 smithi078 ceph-mon[34556]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:31 smithi046 ceph-mon[34147]: pgmap v360: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:31 smithi046 ceph-mon[34147]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.889+0000 7f4ffa070640 1 -- 172.21.15.29:0/2557074270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 msgr2=0x7f4ff410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.889+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2557074270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff410a050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009ca0 tx=0x7f4fec02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.889+0000 7f4ffa070640 1 -- 172.21.15.29:0/2557074270 shutdown_connections 2024-09-19T07:08:31.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.889+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2557074270 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff410a050 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2557074270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff4102e00 0x7f4ff4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2557074270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ff4101c00 0x7f4ff4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 -- 172.21.15.29:0/2557074270 >> 172.21.15.29:0/2557074270 conn(0x7f4ff40fd390 msgr2=0x7f4ff40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 -- 172.21.15.29:0/2557074270 shutdown_connections 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 -- 172.21.15.29:0/2557074270 wait complete. 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 Processor -- start 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.890+0000 7f4ffa070640 1 -- start start 2024-09-19T07:08:31.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ffa070640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ff4101c00 0x7f4ff4075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ffa070640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff4102e00 0x7f4ff40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ffa070640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff4074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ffa070640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410d760 con 0x7f4ff41037c0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ffa070640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410d5e0 con 0x7f4ff4102e00 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ffa070640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff410d8e0 con 0x7f4ff4101c00 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff4074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff4074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34834/0 (socket says 172.21.15.29:34834) 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 -- 172.21.15.29:0/2895496968 learned_addr learned my addr 172.21.15.29:0/2895496968 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff2ffd640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff4102e00 0x7f4ff40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff37fe640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ff4101c00 0x7f4ff4075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 -- 172.21.15.29:0/2895496968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ff4101c00 msgr2=0x7f4ff4075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ff4101c00 0x7f4ff4075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 -- 172.21.15.29:0/2895496968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff4102e00 msgr2=0x7f4ff40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff4102e00 0x7f4ff40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 -- 172.21.15.29:0/2895496968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40753e0 con 0x7f4ff41037c0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff3fff640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff4074b20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4fec031040 tx=0x7f4fec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.891+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec032ec0 con 0x7f4ff41037c0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.892+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4fec0044f0 con 0x7f4ff41037c0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.892+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41a1f10 con 0x7f4ff41037c0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.892+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec030d10 con 0x7f4ff41037c0 2024-09-19T07:08:31.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.892+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a2410 con 0x7f4ff41037c0 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.893+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff4108fd0 con 0x7f4ff41037c0 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.894+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4fec004040 con 0x7f4ff41037c0 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.895+0000 7f4ff0ff9640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4fdc0a3460 0x7f4fdc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.895+0000 7f4ff37fe640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4fdc0a3460 0x7f4fdc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.895+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f4fec0f12b0 con 0x7f4ff41037c0 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.895+0000 7f4ff37fe640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4fdc0a3460 0x7f4fdc0a5920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005db0 tx=0x7f4fe4005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:31.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:31.899+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fec0bdbe0 con 0x7f4ff41037c0 2024-09-19T07:08:32.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.082+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 --> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4ff4062630 con 0x7f4fdc0a3460 2024-09-19T07:08:32.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.085+0000 7f4ff0ff9640 1 -- 172.21.15.29:0/2895496968 <== mgr.14150 v2:172.21.15.29:6800/3056547780 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4ff4062630 con 0x7f4fdc0a3460 2024-09-19T07:08:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T07:08:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009B480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T07:08:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T07:08:32.085 INFO:teuthology.orchestra.run.smithi029.stdout:smithi078 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T07:08:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.086+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4fdc0a3460 msgr2=0x7f4fdc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.086+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4fdc0a3460 0x7f4fdc0a5920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005db0 tx=0x7f4fe4005d40 comp rx=0 tx=0).stop 2024-09-19T07:08:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.086+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 msgr2=0x7f4ff4074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:32.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.086+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff4074b20 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4fec031040 tx=0x7f4fec003ba0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 shutdown_connections 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4ff41037c0 0x7f4ff4074b20 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ff4102e00 0x7f4ff40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f4fdc0a3460 0x7f4fdc0a5920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 --2- 172.21.15.29:0/2895496968 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ff4101c00 0x7f4ff4075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 >> 172.21.15.29:0/2895496968 conn(0x7f4ff40fd390 msgr2=0x7f4ff41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 shutdown_connections 2024-09-19T07:08:32.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:32.087+0000 7f4ffa070640 1 -- 172.21.15.29:0/2895496968 wait complete. 2024-09-19T07:08:32.819 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:08:32.828 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T07:08:32.829 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T07:08:33.087 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:33.509 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:33 smithi029 ceph-mon[31255]: pgmap v361: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:33.509 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:33 smithi029 ceph-mon[31255]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:33.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 -- 172.21.15.29:0/222358102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 msgr2=0x7f3644108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 --2- 172.21.15.29:0/222358102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644108f60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f363c009ca0 tx=0x7f363c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 -- 172.21.15.29:0/222358102 shutdown_connections 2024-09-19T07:08:33.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 --2- 172.21.15.29:0/222358102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644108f60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 --2- 172.21.15.29:0/222358102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644101d10 0x7f3644102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 --2- 172.21.15.29:0/222358102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3644100b10 0x7f3644100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 -- 172.21.15.29:0/222358102 >> 172.21.15.29:0/222358102 conn(0x7f36440fc2a0 msgr2=0x7f36440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 -- 172.21.15.29:0/222358102 shutdown_connections 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.592+0000 7f364acd2640 1 -- 172.21.15.29:0/222358102 wait complete. 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 Processor -- start 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 -- start start 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644100b10 0x7f3644104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3644101d10 0x7f36441030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f364410c6a0 con 0x7f36441026d0 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f364410c520 con 0x7f3644101d10 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364acd2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f364410c820 con 0x7f3644100b10 2024-09-19T07:08:33.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364926f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364926f640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34858/0 (socket says 172.21.15.29:34858) 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f3643fff640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3644101d10 0x7f36441030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.593+0000 7f364926f640 1 -- 172.21.15.29:0/3850814893 learned_addr learned my addr 172.21.15.29:0/3850814893 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f3648a6e640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644100b10 0x7f3644104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364926f640 1 -- 172.21.15.29:0/3850814893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644100b10 msgr2=0x7f3644104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364926f640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644100b10 0x7f3644104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364926f640 1 -- 172.21.15.29:0/3850814893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3644101d10 msgr2=0x7f36441030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364926f640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3644101d10 0x7f36441030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364926f640 1 -- 172.21.15.29:0/3850814893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3644103ef0 con 0x7f36441026d0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364926f640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644103630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f363c009dc0 tx=0x7f363c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c004040 con 0x7f36441026d0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f363c004690 con 0x7f36441026d0 2024-09-19T07:08:33.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36441a1f20 con 0x7f36441026d0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.594+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363c02f4c0 con 0x7f36441026d0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.595+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441a2420 con 0x7f36441026d0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.596+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36441a2710 con 0x7f36441026d0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.597+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f363c0305c0 con 0x7f36441026d0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.597+0000 7f3641ffb640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f36340a32c0 0x7f36340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.597+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f363c0f13c0 con 0x7f36441026d0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.597+0000 7f3648a6e640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f36340a32c0 0x7f36340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.598+0000 7f3648a6e640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f36340a32c0 0x7f36340a5780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f36380058c0 tx=0x7f3638005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:33.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.602+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f363c04d3a0 con 0x7f36441026d0 2024-09-19T07:08:33.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:33 smithi078 ceph-mon[34556]: pgmap v361: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:33.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:33 smithi078 ceph-mon[34556]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:33.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:33 smithi046 ceph-mon[34147]: pgmap v361: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:33.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:33 smithi046 ceph-mon[34147]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:08:33.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.816+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f36441a2cf0 con 0x7f36441026d0 2024-09-19T07:08:33.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.816+0000 7f3641ffb640 1 -- 172.21.15.29:0/3850814893 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+3038 (secure 0 0 0) 0x7f363c0bdd50 con 0x7f36441026d0 2024-09-19T07:08:33.817 INFO:teuthology.orchestra.run.smithi029.stdout:e20 2024-09-19T07:08:33.817 INFO:teuthology.orchestra.run.smithi029.stdout:btime 2024-09-19T07:07:03:013138+0000 2024-09-19T07:08:33.817 INFO:teuthology.orchestra.run.smithi029.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:08:33.817 INFO:teuthology.orchestra.run.smithi029.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:legacy client fscid: 1 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:fs_name cephfs 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 20 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-19T07:06:25.493071+0000 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2024-09-19T07:07:02.814825+0000 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:tableserver 0 2024-09-19T07:08:33.818 INFO:teuthology.orchestra.run.smithi029.stdout:root 0 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:session_timeout 300 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:session_autoclose 300 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:max_file_size 1099511627776 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:max_xattr_size 65536 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:required_client_features {} 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure 0 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:last_failure_osd_epoch 0 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:08:33.819 INFO:teuthology.orchestra.run.smithi029.stdout:max_mds 1 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:in 0 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:up {0=24499} 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:failed 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:damaged 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:stopped 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:data_pools [3,4] 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:metadata_pool 2 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:inline_data disabled 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:balancer 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:bal_rank_mask -1 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:standby_count_wanted 0 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:qdb_cluster leader: 24499 members: 24499 2024-09-19T07:08:33.820 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.i{0:24499} state up:active seq 7 addr [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b{0:24488} state up:standby-replay seq 1 addr [v2:172.21.15.46:6838/865095783,v1:172.21.15.46:6839/865095783] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:Standby daemons: 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.29:6834/3800844322,v1:172.21.15.29:6835/3800844322] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.29:6836/2671963578,v1:172.21.15.29:6837/2671963578] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.g{-1:14601} state up:standby seq 1 addr [v2:172.21.15.29:6838/680020224,v1:172.21.15.29:6839/680020224] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a{-1:14613} state up:standby seq 1 addr [v2:172.21.15.29:6840/2441165637,v1:172.21.15.29:6841/2441165637] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.821 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.k{-1:24422} state up:standby seq 1 addr [v2:172.21.15.46:6832/2053493152,v1:172.21.15.46:6833/2053493152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.822 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.l{-1:24427} state up:standby seq 1 addr [v2:172.21.15.78:6832/1477599720,v1:172.21.15.78:6833/1477599720] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.822 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.e{-1:24440} state up:standby seq 1 addr [v2:172.21.15.46:6834/3031735721,v1:172.21.15.46:6835/3031735721] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.822 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.h{-1:24461} state up:standby seq 1 addr [v2:172.21.15.46:6836/1039888184,v1:172.21.15.46:6837/1039888184] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.822 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.f{-1:24472} state up:standby seq 1 addr [v2:172.21.15.78:6834/1553207007,v1:172.21.15.78:6835/1553207007] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.823 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c{-1:24478} state up:standby seq 1 addr [v2:172.21.15.78:6836/3493854055,v1:172.21.15.78:6837/3493854055] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f36340a32c0 msgr2=0x7f36340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f36340a32c0 0x7f36340a5780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f36380058c0 tx=0x7f3638005850 comp rx=0 tx=0).stop 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 msgr2=0x7f3644103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644103630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f363c009dc0 tx=0x7f363c003ba0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 shutdown_connections 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f36441026d0 0x7f3644103630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3644101d10 0x7f36441030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f36340a32c0 0x7f36340a5780 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 --2- 172.21.15.29:0/3850814893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3644100b10 0x7f3644104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 >> 172.21.15.29:0/3850814893 conn(0x7f36440fc2a0 msgr2=0x7f36440fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:33.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 shutdown_connections 2024-09-19T07:08:33.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:33.819+0000 7f364acd2640 1 -- 172.21.15.29:0/3850814893 wait complete. 2024-09-19T07:08:34.531 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:34 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3850814893' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:08:34.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T07:08:34.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:34 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3850814893' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:08:34.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:34 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3850814893' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:08:34.826 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:35.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 -- 172.21.15.29:0/4132282343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 msgr2=0x7fb71c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 --2- 172.21.15.29:0/4132282343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c100f10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb710009900 tx=0x7fb71002a410 comp rx=0 tx=0).stop 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 -- 172.21.15.29:0/4132282343 shutdown_connections 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 --2- 172.21.15.29:0/4132282343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb71c1026d0 0x7fb71c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 --2- 172.21.15.29:0/4132282343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c101d10 0x7fb71c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 --2- 172.21.15.29:0/4132282343 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c100f10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 -- 172.21.15.29:0/4132282343 >> 172.21.15.29:0/4132282343 conn(0x7fb71c0fc2a0 msgr2=0x7fb71c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 -- 172.21.15.29:0/4132282343 shutdown_connections 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 -- 172.21.15.29:0/4132282343 wait complete. 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 Processor -- start 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.322+0000 7fb7230f7640 1 -- start start 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb71c101d10 0x7fb71c19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c1026d0 0x7fb71c19f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c10c6f0 con 0x7fb71c100b10 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c10c570 con 0x7fb71c1026d0 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb71c10c870 con 0x7fb71c101d10 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:34870/0 (socket says 172.21.15.29:34870) 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 -- 172.21.15.29:0/297467781 learned_addr learned my addr 172.21.15.29:0/297467781 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb721694640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c1026d0 0x7fb71c19f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb71bfff640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb71c101d10 0x7fb71c19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 -- 172.21.15.29:0/297467781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb71c101d10 msgr2=0x7fb71c19cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb71c101d10 0x7fb71c19cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 -- 172.21.15.29:0/297467781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c1026d0 msgr2=0x7fb71c19f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c1026d0 0x7fb71c19f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 -- 172.21.15.29:0/297467781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71c19fad0 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb721694640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c1026d0 0x7fb71c19f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb720e93640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c06b2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb7100314e0 tx=0x7fb710003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71003f070 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71c19fd00 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb710031e40 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.323+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb710035030 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.324+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb71c1a0250 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.325+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb71c107ee0 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.326+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb710042070 con 0x7fb71c100b10 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.327+0000 7fb719ffb640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb70c0a3240 0x7fb70c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.327+0000 7fb71bfff640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb70c0a3240 0x7fb70c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:35.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.327+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb7100f07a0 con 0x7fb71c100b10 2024-09-19T07:08:35.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.327+0000 7fb71bfff640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb70c0a3240 0x7fb70c0a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb708005e10 tx=0x7fb708005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:35.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.331+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7100bd0d0 con 0x7fb71c100b10 2024-09-19T07:08:35.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.508+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fb71c062e90 con 0x7fb71c100b10 2024-09-19T07:08:35.509 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:35 smithi029 ceph-mon[31255]: pgmap v362: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.509+0000 7fb719ffb640 1 -- 172.21.15.29:0/297467781 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) ==== 56+0+5620 (secure 0 0 0) 0x7fb7100bc9d0 con 0x7fb71c100b10 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 92 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:fsid 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-19T06:58:24.064514+0000 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:modified 2024-09-19T07:08:15.648219+0000 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:crush_version 27 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:full_ratio 0.95 2024-09-19T07:08:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:backfillfull_ratio 0.9 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:nearfull_ratio 0.85 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:require_min_compat_client luminous 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:min_compat_client luminous 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:require_osd_release squid 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:stretch_mode_enabled false 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:max_osd 12 2024-09-19T07:08:35.511 INFO:teuthology.orchestra.run.smithi029.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6802/1401604142,v1:172.21.15.29:6803/1401604142] [v2:172.21.15.29:6804/1401604142,v1:172.21.15.29:6805/1401604142] exists,up 18b7cd4a-16e1-4292-8991-1c3e988879b9 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.1 up in weight 1 up_from 13 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6800/4060805731,v1:172.21.15.46:6801/4060805731] [v2:172.21.15.46:6802/4060805731,v1:172.21.15.46:6803/4060805731] exists,up 14b5d96f-091a-4d2c-99b2-204239338305 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6800/2352788305,v1:172.21.15.78:6801/2352788305] [v2:172.21.15.78:6802/2352788305,v1:172.21.15.78:6803/2352788305] exists,up 2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.3 up in weight 1 up_from 24 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6810/1809490349,v1:172.21.15.29:6811/1809490349] [v2:172.21.15.29:6812/1809490349,v1:172.21.15.29:6813/1809490349] exists,up 9fba4b13-f243-4dad-a64c-1f374ee7fdc8 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.4 up in weight 1 up_from 32 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6808/4193654179,v1:172.21.15.46:6809/4193654179] [v2:172.21.15.46:6810/4193654179,v1:172.21.15.46:6811/4193654179] exists,up 4a3fe9f3-e212-42a4-b3c0-06cc2e50c622 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.5 up in weight 1 up_from 37 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6808/2442048151,v1:172.21.15.78:6809/2442048151] [v2:172.21.15.78:6810/2442048151,v1:172.21.15.78:6811/2442048151] exists,up bb3d9461-1e47-4e1d-be8e-583f94501d3e 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.6 up in weight 1 up_from 44 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6818/4093011599,v1:172.21.15.29:6819/4093011599] [v2:172.21.15.29:6820/4093011599,v1:172.21.15.29:6821/4093011599] exists,up ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.7 up in weight 1 up_from 49 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6816/669772686,v1:172.21.15.46:6817/669772686] [v2:172.21.15.46:6818/669772686,v1:172.21.15.46:6819/669772686] exists,up 54e4494b-0f7a-42d4-a840-18a685821466 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.8 up in weight 1 up_from 56 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6816/738881945,v1:172.21.15.78:6817/738881945] [v2:172.21.15.78:6818/738881945,v1:172.21.15.78:6819/738881945] exists,up 0d3f5854-9361-45b2-b1b5-5d1dc46ca568 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.9 up in weight 1 up_from 64 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.29:6826/3365910689,v1:172.21.15.29:6827/3365910689] [v2:172.21.15.29:6828/3365910689,v1:172.21.15.29:6829/3365910689] exists,up b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.10 up in weight 1 up_from 69 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6824/1753918148,v1:172.21.15.46:6825/1753918148] [v2:172.21.15.46:6826/1753918148,v1:172.21.15.46:6827/1753918148] exists,up 0d8f44c8-3b48-47ba-80cd-cee544a6cb3c 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:osd.11 up in weight 1 up_from 76 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.78:6824/442617082,v1:172.21.15.78:6825/442617082] [v2:172.21.15.78:6826/442617082,v1:172.21.15.78:6827/442617082] exists,up bd582454-ad0c-4343-b2fa-e314def66709 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T07:08:35.512 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.b [2,4] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.e [2,4] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.f [8,11] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 2.1f [8,1] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.3 [4,9] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.1d [5,9] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 3.36 [4,9] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 4.f [5,8] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 4.19 [9,8] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 4.1b [9,10] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:pg_upmap_items 4.1f [9,8] 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/1356479078 expires 2024-09-20T06:59:13.753465+0000 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6800/1256989766 expires 2024-09-20T06:59:13.753465+0000 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/4183681078 expires 2024-09-20T06:59:13.753465+0000 2024-09-19T07:08:35.513 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/48340936 expires 2024-09-20T06:58:48.466085+0000 2024-09-19T07:08:35.514 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/4173493605 expires 2024-09-20T06:59:13.753465+0000 2024-09-19T07:08:35.514 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6801/1256989766 expires 2024-09-20T06:59:13.753465+0000 2024-09-19T07:08:35.514 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/3569463944 expires 2024-09-20T06:58:48.466085+0000 2024-09-19T07:08:35.514 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6801/3793715048 expires 2024-09-20T06:58:48.466085+0000 2024-09-19T07:08:35.514 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:6800/3793715048 expires 2024-09-20T06:58:48.466085+0000 2024-09-19T07:08:35.514 INFO:teuthology.orchestra.run.smithi029.stdout:blocklist 172.21.15.29:0/1689760555 expires 2024-09-20T06:58:48.466085+0000 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb70c0a3240 msgr2=0x7fb70c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb70c0a3240 0x7fb70c0a5700 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb708005e10 tx=0x7fb708005da0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 msgr2=0x7fb71c06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c06b2f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb7100314e0 tx=0x7fb710003d50 comp rx=0 tx=0).stop 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 shutdown_connections 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb71c1026d0 0x7fb71c19f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb70c0a3240 0x7fb70c0a5700 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb71c101d10 0x7fb71c19cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.512+0000 7fb7230f7640 1 --2- 172.21.15.29:0/297467781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c100b10 0x7fb71c06b2f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.513+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 >> 172.21.15.29:0/297467781 conn(0x7fb71c0fc2a0 msgr2=0x7fb71c1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.513+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 shutdown_connections 2024-09-19T07:08:35.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:35.513+0000 7fb7230f7640 1 -- 172.21.15.29:0/297467781 wait complete. 2024-09-19T07:08:35.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:35 smithi078 ceph-mon[34556]: pgmap v362: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:35 smithi046 ceph-mon[34147]: pgmap v362: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:36.291 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T07:08:36.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:36.564 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:36.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:36 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/297467781' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:08:36.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:36 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/297467781' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:08:36.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:36 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/297467781' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:08:37.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 -- 172.21.15.29:0/2654320222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101200 msgr2=0x7fefd4101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:37.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2654320222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101200 0x7fefd4101660 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009900 tx=0x7fefc802a410 comp rx=0 tx=0).stop 2024-09-19T07:08:37.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 -- 172.21.15.29:0/2654320222 shutdown_connections 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2654320222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101ba0 0x7fefd410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2654320222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101200 0x7fefd4101660 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2654320222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefd4105ad0 0x7fefd4105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 -- 172.21.15.29:0/2654320222 >> 172.21.15.29:0/2654320222 conn(0x7fefd4077210 msgr2=0x7fefd40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 -- 172.21.15.29:0/2654320222 shutdown_connections 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.056+0000 7fefda8b1640 1 -- 172.21.15.29:0/2654320222 wait complete. 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 Processor -- start 2024-09-19T07:08:37.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 -- start start 2024-09-19T07:08:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101200 0x7fefd40fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 0x7fefd40fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefd4105ad0 0x7fefd40fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4110da0 con 0x7fefd4101ba0 2024-09-19T07:08:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4110c20 con 0x7fefd4101200 2024-09-19T07:08:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefda8b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4110f20 con 0x7fefd4105ad0 2024-09-19T07:08:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefd37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 0x7fefd40fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefd37fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 0x7fefd40fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52316/0 (socket says 172.21.15.29:52316) 2024-09-19T07:08:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefd37fe640 1 -- 172.21.15.29:0/2092996862 learned_addr learned my addr 172.21.15.29:0/2092996862 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.057+0000 7fefd3fff640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101200 0x7fefd40fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd8e4e640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefd4105ad0 0x7fefd40fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:37.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd37fe640 1 -- 172.21.15.29:0/2092996862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefd4105ad0 msgr2=0x7fefd40fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd37fe640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefd4105ad0 0x7fefd40fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd37fe640 1 -- 172.21.15.29:0/2092996862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101200 msgr2=0x7fefd40fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd37fe640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101200 0x7fefd40fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd37fe640 1 -- 172.21.15.29:0/2092996862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd41a67b0 con 0x7fefd4101ba0 2024-09-19T07:08:37.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd37fe640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 0x7fefd40fcbd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fefc8006010 tx=0x7fefc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc803f030 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fefc8003aa0 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd41a6a40 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8035070 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.058+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd41a6f70 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.059+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd4101660 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.060+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fefc8042030 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.061+0000 7fefd17fa640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fefbc0a32c0 0x7fefbc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.061+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fefc80f0250 con 0x7fefd4101ba0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.061+0000 7fefd3fff640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fefbc0a32c0 0x7fefbc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.061+0000 7fefd3fff640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fefbc0a32c0 0x7fefbc0a5780 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009b50 tx=0x7fefc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.065+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefc80bcb80 con 0x7fefd4101ba0 2024-09-19T07:08:37.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.280+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefd40fdbc0 con 0x7fefd4101ba0 2024-09-19T07:08:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.281+0000 7fefd17fa640 1 -- 172.21.15.29:0/2092996862 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7fefd40fdbc0 con 0x7fefd4101ba0 2024-09-19T07:08:37.282 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:37.282 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:08:37.282 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fefbc0a32c0 msgr2=0x7fefbc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fefbc0a32c0 0x7fefbc0a5780 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009b50 tx=0x7fefc4005f90 comp rx=0 tx=0).stop 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 msgr2=0x7fefd40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 0x7fefd40fcbd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fefc8006010 tx=0x7fefc8004270 comp rx=0 tx=0).stop 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 shutdown_connections 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fefbc0a32c0 0x7fefbc0a5780 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fefd4105ad0 0x7fefd40fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefd4101ba0 0x7fefd40fcbd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 --2- 172.21.15.29:0/2092996862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101200 0x7fefd40fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:37.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 >> 172.21.15.29:0/2092996862 conn(0x7fefd4077210 msgr2=0x7fefd4100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:37.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 shutdown_connections 2024-09-19T07:08:37.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:37.283+0000 7fefda8b1640 1 -- 172.21.15.29:0/2092996862 wait complete. 2024-09-19T07:08:37.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:37 smithi029 ceph-mon[31255]: pgmap v363: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:37.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:37 smithi078 ceph-mon[34556]: pgmap v363: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:37 smithi046 ceph-mon[34147]: pgmap v363: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:38.033 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:08:38.298 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:38.549 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2092996862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:38.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2092996862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:38.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2092996862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 -- 172.21.15.29:0/1676725190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150101420 msgr2=0x7fc15010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 --2- 172.21.15.29:0/1676725190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150101420 0x7fc15010d950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc148009930 tx=0x7fc14802a420 comp rx=0 tx=0).stop 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 -- 172.21.15.29:0/1676725190 shutdown_connections 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 --2- 172.21.15.29:0/1676725190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150101420 0x7fc15010d950 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 --2- 172.21.15.29:0/1676725190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150100a80 0x7fc150100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 --2- 172.21.15.29:0/1676725190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc150106a80 0x7fc150106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 -- 172.21.15.29:0/1676725190 >> 172.21.15.29:0/1676725190 conn(0x7fc1500fc7a0 msgr2=0x7fc1500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 -- 172.21.15.29:0/1676725190 shutdown_connections 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.787+0000 7fc157336640 1 -- 172.21.15.29:0/1676725190 wait complete. 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 Processor -- start 2024-09-19T07:08:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 -- start start 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 0x7fc150198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc150101420 0x7fc1501988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150106a80 0x7fc15019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc150110d30 con 0x7fc150100a80 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc150110bb0 con 0x7fc150106a80 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc157336640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc150110eb0 con 0x7fc150101420 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc1550d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 0x7fc150198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc1550d2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 0x7fc150198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52324/0 (socket says 172.21.15.29:52324) 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc1550d2640 1 -- 172.21.15.29:0/1956932414 learned_addr learned my addr 172.21.15.29:0/1956932414 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc1558d3640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150106a80 0x7fc15019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.788+0000 7fc1548d1640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc150101420 0x7fc1501988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1550d2640 1 -- 172.21.15.29:0/1956932414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc150101420 msgr2=0x7fc1501988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1550d2640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc150101420 0x7fc1501988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1550d2640 1 -- 172.21.15.29:0/1956932414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150106a80 msgr2=0x7fc15019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1550d2640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150106a80 0x7fc15019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1550d2640 1 -- 172.21.15.29:0/1956932414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15019d320 con 0x7fc150100a80 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1558d3640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150106a80 0x7fc15019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc1550d2640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 0x7fc150198370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc14000ea80 tx=0x7fc14000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14000ce40 con 0x7fc150100a80 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc140005020 con 0x7fc150100a80 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc15019d610 con 0x7fc150100a80 2024-09-19T07:08:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1400116d0 con 0x7fc150100a80 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.789+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1501a4ef0 con 0x7fc150100a80 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.790+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150100ee0 con 0x7fc150100a80 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.791+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc1400051d0 con 0x7fc150100a80 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.792+0000 7fc14e7fc640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc1380a3240 0x7fc1380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.792+0000 7fc1548d1640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc1380a3240 0x7fc1380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.792+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc1400cffe0 con 0x7fc150100a80 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.792+0000 7fc1548d1640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc1380a3240 0x7fc1380a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc150105220 tx=0x7fc14400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:38.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:38.796+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc140016030 con 0x7fc150100a80 2024-09-19T07:08:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.012+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc15010a030 con 0x7fc150100a80 2024-09-19T07:08:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.013+0000 7fc14e7fc640 1 -- 172.21.15.29:0/1956932414 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7fc14009c950 con 0x7fc150100a80 2024-09-19T07:08:39.013 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:39.014 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:08:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:08:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc1380a3240 msgr2=0x7fc1380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc1380a3240 0x7fc1380a5700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc150105220 tx=0x7fc14400a4c0 comp rx=0 tx=0).stop 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 msgr2=0x7fc150198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 0x7fc150198370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc14000ea80 tx=0x7fc14000ef40 comp rx=0 tx=0).stop 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 shutdown_connections 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc150106a80 0x7fc15019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc1380a3240 0x7fc1380a5700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc150101420 0x7fc1501988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 --2- 172.21.15.29:0/1956932414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc150100a80 0x7fc150198370 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 >> 172.21.15.29:0/1956932414 conn(0x7fc1500fc7a0 msgr2=0x7fc15006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 shutdown_connections 2024-09-19T07:08:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:39.015+0000 7fc157336640 1 -- 172.21.15.29:0/1956932414 wait complete. 2024-09-19T07:08:39.498 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:39 smithi029 ceph-mon[31255]: pgmap v364: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:39.498 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:39 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1956932414' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:39 smithi078 ceph-mon[34556]: pgmap v364: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:39.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:39 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1956932414' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:39 smithi046 ceph-mon[34147]: pgmap v364: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:39 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1956932414' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:08:39.886 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:08:40.150 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 -- 172.21.15.29:0/3102966033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8106a80 msgr2=0x7f52b8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/3102966033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8106a80 0x7f52b8106e60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009930 tx=0x7f52a802a420 comp rx=0 tx=0).stop 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 -- 172.21.15.29:0/3102966033 shutdown_connections 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/3102966033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b8101420 0x7f52b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/3102966033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b8100a80 0x7f52b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/3102966033 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8106a80 0x7f52b8106e60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 -- 172.21.15.29:0/3102966033 >> 172.21.15.29:0/3102966033 conn(0x7f52b80fc7a0 msgr2=0x7f52b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 -- 172.21.15.29:0/3102966033 shutdown_connections 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.630+0000 7f52bcaa0640 1 -- 172.21.15.29:0/3102966033 wait complete. 2024-09-19T07:08:40.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 Processor -- start 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 -- start start 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 0x7f52b80fceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b8101420 0x7f52b80fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b8106a80 0x7f52b80fd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8110dd0 con 0x7f52b8100a80 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8110c50 con 0x7f52b8101420 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52bcaa0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8110f50 con 0x7f52b8106a80 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52b659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 0x7f52b80fceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52b659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 0x7f52b80fceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52330/0 (socket says 172.21.15.29:52330) 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52b659c640 1 -- 172.21.15.29:0/1174103614 learned_addr learned my addr 172.21.15.29:0/1174103614 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.631+0000 7f52affff640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b8101420 0x7f52b80fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:40.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b6d9d640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b8106a80 0x7f52b80fd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b659c640 1 -- 172.21.15.29:0/1174103614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b8106a80 msgr2=0x7f52b80fd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b659c640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b8106a80 0x7f52b80fd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b659c640 1 -- 172.21.15.29:0/1174103614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b8101420 msgr2=0x7f52b80fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b659c640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b8101420 0x7f52b80fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b659c640 1 -- 172.21.15.29:0/1174103614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b81a69c0 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52b659c640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 0x7f52b80fceb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005940 tx=0x7f52a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a803f030 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f52a8003cb0 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b81a6c50 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a8035070 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.632+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b81a7130 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.634+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b8100f60 con 0x7f52b8100a80 2024-09-19T07:08:40.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.635+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f52a8042030 con 0x7f52b8100a80 2024-09-19T07:08:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.635+0000 7f52af7fe640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f52a40a3240 0x7f52a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.635+0000 7f52affff640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f52a40a3240 0x7f52a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.635+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f52a80f0250 con 0x7f52b8100a80 2024-09-19T07:08:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.636+0000 7f52affff640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f52a40a3240 0x7f52a40a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f52b80fe940 tx=0x7f52a0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:40.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.639+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52a80bcbe0 con 0x7f52b8100a80 2024-09-19T07:08:40.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.823+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52b810a000 con 0x7f52b8100a80 2024-09-19T07:08:40.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.825+0000 7f52af7fe640 1 -- 172.21.15.29:0/1174103614 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24747 (secure 0 0 0) 0x7f52a80bc4e0 con 0x7f52b8100a80 2024-09-19T07:08:40.826 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:40.826 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":92,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:08:15.648219+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:08:40.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.827+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f52a40a3240 msgr2=0x7f52a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:40.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.827+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f52a40a3240 0x7f52a40a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f52b80fe940 tx=0x7f52a0009110 comp rx=0 tx=0).stop 2024-09-19T07:08:40.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.827+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 msgr2=0x7f52b80fceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.827+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 0x7f52b80fceb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005940 tx=0x7f52a80042f0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 shutdown_connections 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f52a40a3240 0x7f52a40a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b8106a80 0x7f52b80fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52b8101420 0x7f52b80fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 --2- 172.21.15.29:0/1174103614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52b8100a80 0x7f52b80fceb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 >> 172.21.15.29:0/1174103614 conn(0x7f52b80fc7a0 msgr2=0x7f52b806abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 shutdown_connections 2024-09-19T07:08:40.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:40.828+0000 7f52bcaa0640 1 -- 172.21.15.29:0/1174103614 wait complete. 2024-09-19T07:08:41.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:41 smithi029 ceph-mon[31255]: pgmap v365: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:41.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:41 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1174103614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:41.670 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:06:25.493071+0000', 'modified': '2024-09-19T07:07:02.814825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24488': {'gid': 24488, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/865095783', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 865095783}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 865095783}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.78:6839/2907917016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6838', 'nonce': 2907917016}, {'type': 'v1', 'addr': '172.21.15.78:6839', 'nonce': 2907917016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24499, 'qdb_cluster': [24499]} 2024-09-19T07:08:41.671 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T07:08:41.671 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:08:41.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:41 smithi078 ceph-mon[34556]: pgmap v365: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:41.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:41 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1174103614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:41 smithi046 ceph-mon[34147]: pgmap v365: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:41 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1174103614' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:08:41.935 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:42.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.473+0000 7f0cad1e8640 1 -- 172.21.15.29:0/1925319838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8102ef0 msgr2=0x7f0ca810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/1925319838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8102ef0 0x7f0ca810da40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009ca0 tx=0x7f0ca002a950 comp rx=0 tx=0).stop 2024-09-19T07:08:42.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 -- 172.21.15.29:0/1925319838 shutdown_connections 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/1925319838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8102ef0 0x7f0ca810da40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/1925319838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca8102570 0x7f0ca81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/1925319838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ca8100e20 0x7f0ca8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 -- 172.21.15.29:0/1925319838 >> 172.21.15.29:0/1925319838 conn(0x7f0ca80fc7d0 msgr2=0x7f0ca80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 -- 172.21.15.29:0/1925319838 shutdown_connections 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 -- 172.21.15.29:0/1925319838 wait complete. 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.474+0000 7f0cad1e8640 1 Processor -- start 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 -- start start 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 0x7f0ca80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca8102570 0x7f0ca80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ca8102ef0 0x7f0ca80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8110e80 con 0x7f0ca8100e20 2024-09-19T07:08:42.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8110d00 con 0x7f0ca8102ef0 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0cad1e8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca8111000 con 0x7f0ca8102570 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 0x7f0ca80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca8102570 0x7f0ca80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 0x7f0ca80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52340/0 (socket says 172.21.15.29:52340) 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 -- 172.21.15.29:0/2492306631 learned_addr learned my addr 172.21.15.29:0/2492306631 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca759e640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ca8102ef0 0x7f0ca80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 -- 172.21.15.29:0/2492306631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca8102570 msgr2=0x7f0ca80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca8102570 0x7f0ca80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 -- 172.21.15.29:0/2492306631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ca8102ef0 msgr2=0x7f0ca80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ca8102ef0 0x7f0ca80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.475+0000 7f0ca6d9d640 1 -- 172.21.15.29:0/2492306631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca81a6880 con 0x7f0ca8100e20 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.476+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 0x7f0ca80fcc80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800d950 tx=0x7f0c9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.494 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.476+0000 7f0c8ffff640 1 -- 172.21.15.29:0/2492306631 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98017030 con 0x7f0ca8100e20 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.476+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca81a6b70 con 0x7f0ca8100e20 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.476+0000 7f0c8ffff640 1 -- 172.21.15.29:0/2492306631 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c98004020 con 0x7f0ca8100e20 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.476+0000 7f0c8ffff640 1 -- 172.21.15.29:0/2492306631 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c980047a0 con 0x7f0ca8100e20 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.476+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca81a70b0 con 0x7f0ca8100e20 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.478+0000 7f0c8ffff640 1 -- 172.21.15.29:0/2492306631 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0c980041d0 con 0x7f0ca8100e20 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 Processor -- start 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 -- start start 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 0x5636d597ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597e2f0 0x5636d5988670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d598afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5636d58e4090 con 0x5636d597d9d0 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5636d588ba70 con 0x5636d597e2f0 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5636d58e0050 con 0x5636d5988bb0 2024-09-19T07:08:42.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 0x5636d597ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 0x5636d597ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52344/0 (socket says 172.21.15.29:52344) 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 -- 172.21.15.29:0/2257170589 learned_addr learned my addr 172.21.15.29:0/2257170589 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0c8ffff640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0c900a3240 0x7f0c900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597e2f0 0x5636d5988670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca659c640 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d598afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 -- 172.21.15.29:0/2257170589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 msgr2=0x5636d598afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d598afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 -- 172.21.15.29:0/2257170589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597e2f0 msgr2=0x5636d5988670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597e2f0 0x5636d5988670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca759e640 1 -- 172.21.15.29:0/2257170589 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d5898130 con 0x5636d597d9d0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.479+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597e2f0 0x5636d5988670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.480+0000 7f0ca759e640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0c900a3240 0x7f0c900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.480+0000 7f0c8ffff640 1 -- 172.21.15.29:0/2492306631 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0c980cf7a0 con 0x7f0ca8100e20 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.480+0000 7f0ca759e640 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 0x5636d597ddb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0035000 tx=0x7f0ca002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f077bb20c76dd0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.480+0000 7f0c8d7fa640 1 -- 172.21.15.29:0/2257170589 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0041040 con 0x5636d597d9d0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.480+0000 7f0c8d7fa640 1 -- 172.21.15.29:0/2257170589 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0ca002fd10 con 0x5636d597d9d0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.480+0000 7f0c8d7fa640 1 -- 172.21.15.29:0/2257170589 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0034040 con 0x5636d597d9d0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- 172.21.15.29:0/2257170589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 msgr2=0x5636d597ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0ca759e640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0c900a3240 0x7f0c900a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ca004c000 tx=0x7f0ca004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 0x5636d597ddb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0035000 tx=0x7f0ca002f450 comp rx=0 tx=0).stop 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- 172.21.15.29:0/2257170589 shutdown_connections 2024-09-19T07:08:42.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d598afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597e2f0 0x5636d5988670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/2257170589 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597d9d0 0x5636d597ddb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- 172.21.15.29:0/2257170589 >> 172.21.15.29:0/2257170589 conn(0x5636d5979f60 msgr2=0x5636d597a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- 172.21.15.29:0/2257170589 shutdown_connections 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- 172.21.15.29:0/2257170589 wait complete. 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- start start 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 Processor -- start 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5988460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d5985cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5636d598b780 con 0x5636d597e2f0 2024-09-19T07:08:42.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.481+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5636d589ef20 con 0x5636d597d9d0 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5636d598b900 con 0x5636d5988bb0 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0caf5c1740 10 client.0 _ll_register_callbacks cb 0x5636d5868030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59857b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52348/0 (socket says 172.21.15.29:52348) 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 -- 172.21.15.29:0/1324709635 learned_addr learned my addr 172.21.15.29:0/1324709635 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5988460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca759e640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d5985cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 -- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 msgr2=0x5636d5985cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d5985cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 -- 172.21.15.29:0/1324709635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 msgr2=0x5636d5988460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5988460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 -- 172.21.15.29:0/1324709635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d56552b0 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0ca659c640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59857b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b910 tx=0x7f0c9c00bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1d94bc81acd8ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0c8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0c8aff5640 1 -- 172.21.15.29:0/1324709635 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c01b470 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0c8aff5640 1 -- 172.21.15.29:0/1324709635 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0c9c01b610 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ca002fd10 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0c8aff5640 1 -- 172.21.15.29:0/1324709635 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0c9c024050 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.482+0000 7f0caf5c1740 10 client.15162 fetch_fsmap learned FSMap version 20 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5636d5997070 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0c8aff5640 1 -- 172.21.15.29:0/1324709635 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0ca002fd10 con 0x5636d597e2f0 2024-09-19T07:08:42.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0c8aff5640 1 -- 172.21.15.29:0/1324709635 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f0c9c012950 con 0x5636d597e2f0 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 10 client.15162 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 10 client.15162 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 20 client.15162 populate_metadata read hostname 'smithi029' 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d59996e0 0x5636d599ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 4 client.15162 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 --> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636d58f1600 con 0x5636d59996e0 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.483+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d59996e0 0x5636d599ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.484+0000 7f0c8aff5640 10 client.15162 ms_handle_connect on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.484+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d59996e0 0x5636d599ab50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229e3e45fb9c790b server_cookie=96cae0db67b7b82b in_seq=0 out_seq=0 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.484+0000 7f0c8aff5640 1 -- 172.21.15.29:0/1324709635 <== mds.0 v2:172.21.15.78:6838/2907917016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636d58f1600 con 0x5636d59996e0 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.484+0000 7f0c8aff5640 10 client.15162 handle_command_reply: tid=0 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.484+0000 7f0caf5c1740 1 client.15162 shutdown 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 msgr2=0x5636d59857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59857b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00b910 tx=0x7f0c9c00bdd0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 shutdown_connections 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d59996e0 0x5636d599ab50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d5985cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59857b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0c8aff5640 0 client.15162 ms_handle_reset on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/1324709635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5988460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 >> 172.21.15.29:0/1324709635 conn(0x5636d5979f60 msgr2=0x5636d597fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 shutdown_connections 2024-09-19T07:08:42.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 1 -- 172.21.15.29:0/1324709635 wait complete. 2024-09-19T07:08:42.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.485+0000 7f0caf5c1740 20 client.15162 trim_cache size 0 max 16384 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.503+0000 7f0caf5c1740 1 Processor -- start 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.503+0000 7f0caf5c1740 1 -- start start 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.503+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5984790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d59a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5636d5998e90 con 0x5636d597e2f0 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5636d5999560 con 0x5636d597d9d0 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5636d5999c30 con 0x5636d5988bb0 2024-09-19T07:08:42.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52354/0 (socket says 172.21.15.29:52354) 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 -- 172.21.15.29:0/552722191 learned_addr learned my addr 172.21.15.29:0/552722191 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5984790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca759e640 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d59a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 -- 172.21.15.29:0/552722191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 msgr2=0x5636d59a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d59a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 -- 172.21.15.29:0/552722191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 msgr2=0x5636d5984790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5984790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 -- 172.21.15.29:0/552722191 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636d597d800 con 0x5636d597e2f0 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5984790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0ca659c640 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a2e30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c012fd0 tx=0x7f0c9c004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a846608227bd2560 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0c8cff9640 1 -- 172.21.15.29:0/552722191 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0039c0 con 0x5636d597e2f0 2024-09-19T07:08:42.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0c8cff9640 1 -- 172.21.15.29:0/552722191 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c9c016070 con 0x5636d597e2f0 2024-09-19T07:08:42.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.504+0000 7f0c8cff9640 1 -- 172.21.15.29:0/552722191 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c012870 con 0x5636d597e2f0 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 -- 172.21.15.29:0/552722191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 msgr2=0x5636d59a2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a2e30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c012fd0 tx=0x7f0c9c004480 comp rx=0 tx=0).stop 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 -- 172.21.15.29:0/552722191 shutdown_connections 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d59a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a2e30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/552722191 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d5984790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 -- 172.21.15.29:0/552722191 >> 172.21.15.29:0/552722191 conn(0x5636d5979f60 msgr2=0x5636d5984080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 -- 172.21.15.29:0/552722191 shutdown_connections 2024-09-19T07:08:42.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.505+0000 7f0caf5c1740 1 -- 172.21.15.29:0/552722191 wait complete. 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 -- start start 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 Processor -- start 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d59a3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d599e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x5636d599a9d0 con 0x5636d597e2f0 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5636d599a300 con 0x5636d597d9d0 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5636d599b0a0 con 0x5636d5988bb0 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0caf5c1740 10 client.0 _ll_register_callbacks cb 0x7f0c9c004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52364/0 (socket says 172.21.15.29:52364) 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 -- 172.21.15.29:0/841879102 learned_addr learned my addr 172.21.15.29:0/841879102 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:42.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca759e640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d599e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d59a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 -- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 msgr2=0x5636d599e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d599e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 -- 172.21.15.29:0/841879102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 msgr2=0x5636d59a3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d59a3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca659c640 1 -- 172.21.15.29:0/841879102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636d599ef30 con 0x5636d597e2f0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.506+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d59a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0ca659c640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a36c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00be10 tx=0x7f0c9c003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f529ecb152410d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0c8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.29:3300/0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0c8aff5640 1 -- 172.21.15.29:0/841879102 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c035070 con 0x5636d597e2f0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0c8aff5640 1 -- 172.21.15.29:0/841879102 <== mon.0 v2:172.21.15.29:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f0c9c012990 con 0x5636d597e2f0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c9c016070 con 0x5636d597e2f0 2024-09-19T07:08:42.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0c8aff5640 1 -- 172.21.15.29:0/841879102 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0c9c041050 con 0x5636d597e2f0 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0caf5c1740 10 client.15168 fetch_fsmap learned FSMap version 20 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=4+}) -- 0x5636d5a03a30 con 0x5636d597e2f0 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0c8aff5640 1 -- 172.21.15.29:0/841879102 <== mon.0 v2:172.21.15.29:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c9c016070 con 0x5636d597e2f0 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0c8aff5640 1 -- 172.21.15.29:0/841879102 <== mon.0 v2:172.21.15.29:3300/0 5 ==== fsmap(e 20) ==== 8338+0+0 (secure 0 0 0) 0x7f0c9c030450 con 0x5636d597e2f0 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0caf5c1740 10 client.15168 fetch_fsmap finished waiting for FSMap version 20 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0caf5c1740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.507+0000 7f0caf5c1740 20 client.15168 populate_metadata read hostname 'smithi029' 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d5a08270 0x5636d5a06f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0caf5c1740 4 client.15168 mds_command: new command op to 24499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 --> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] -- command(tid 0: {"prefix": "status"}) -- 0x5636d58ebb10 con 0x5636d5a08270 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d5a08270 0x5636d5a06f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0ca6d9d640 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d5a08270 0x5636d5a06f80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8e458682b99fa server_cookie=f267fb5547af3200 in_seq=0 out_seq=0 2024-09-19T07:08:42.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0c8aff5640 10 client.15168 ms_handle_connect on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0c8aff5640 1 -- 172.21.15.29:0/841879102 <== mds.0 v2:172.21.15.78:6838/2907917016 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5636d58ebb10 con 0x5636d5a08270 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0c8aff5640 10 client.15168 handle_command_reply: tid=0 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.508+0000 7f0caf5c1740 1 client.15168 shutdown 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 msgr2=0x5636d59a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a36c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00be10 tx=0x7f0c9c003b00 comp rx=0 tx=0).stop 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 shutdown_connections 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:6838/2907917016,v1:172.21.15.78:6839/2907917016] conn(0x5636d5a08270 0x5636d5a06f80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5636d5988bb0 0x5636d599e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5636d597e2f0 0x5636d59a36c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 --2- 172.21.15.29:0/841879102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5636d597d9d0 0x5636d59a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 >> 172.21.15.29:0/841879102 conn(0x5636d5979f60 msgr2=0x5636d5979000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0c8aff5640 0 client.15168 ms_handle_reset on v2:172.21.15.78:6838/2907917016 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 shutdown_connections 2024-09-19T07:08:42.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 1 -- 172.21.15.29:0/841879102 wait complete. 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0caf5c1740 20 client.15168 trim_cache size 0 max 16384 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "cluster_fsid": "6a046fca-7654-11ef-bceb-c7b262605968", 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "whoami": 0, 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 24499, 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "want_state": "up:active", 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "state": "up:active", 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs", 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "rank_uptime": 136.70852651000001, 2024-09-19T07:08:42.515 INFO:teuthology.orchestra.run.smithi029.stdout: "mdsmap_epoch": 20, 2024-09-19T07:08:42.516 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch": 92, 2024-09-19T07:08:42.516 INFO:teuthology.orchestra.run.smithi029.stdout: "osdmap_epoch_barrier": 88, 2024-09-19T07:08:42.516 INFO:teuthology.orchestra.run.smithi029.stdout: "uptime": 157.15139654199999 2024-09-19T07:08:42.516 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T07:08:42.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0c900a3240 msgr2=0x7f0c900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0c900a3240 0x7f0c900a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ca004c000 tx=0x7f0ca004d000 comp rx=0 tx=0).stop 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 msgr2=0x7f0ca80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 0x7f0ca80fcc80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800d950 tx=0x7f0c9800de10 comp rx=0 tx=0).stop 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 shutdown_connections 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0ca8102ef0 0x7f0ca80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f0c900a3240 0x7f0c900a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ca8102570 0x7f0ca80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 --2- 172.21.15.29:0/2492306631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8100e20 0x7f0ca80fcc80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.509+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 >> 172.21.15.29:0/2492306631 conn(0x7f0ca80fc7d0 msgr2=0x7f0ca806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.510+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 shutdown_connections 2024-09-19T07:08:42.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:42.510+0000 7f0cad1e8640 1 -- 172.21.15.29:0/2492306631 wait complete. 2024-09-19T07:08:43.346 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T07:08:43.356 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T07:08:43.356 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T07:08:43.356 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T07:08:43.356 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T07:08:43.414 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T07:08:43.414 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T07:08:43.414 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-19T07:08:43.415 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T07:08:43.415 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-19T07:08:43.415 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-19T07:08:43.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:43.415 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-19T07:08:43.433 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T07:08:43.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:43.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T07:08:43.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:43.504 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-09-19T07:08:43.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:43 smithi029 ceph-mon[31255]: pgmap v366: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:43.579 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T07:08:43.579 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T07:08:43.580 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T07:08:43.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:43 smithi078 ceph-mon[34556]: pgmap v366: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:43.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:43 smithi046 ceph-mon[34147]: pgmap v366: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:43.842 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:08:44.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 -- 172.21.15.29:0/1298509015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 msgr2=0x7f73901067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:44.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 --2- 172.21.15.29:0/1298509015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f73901067e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7384009900 tx=0x7f738402a410 comp rx=0 tx=0).stop 2024-09-19T07:08:44.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 -- 172.21.15.29:0/1298509015 shutdown_connections 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 --2- 172.21.15.29:0/1298509015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7390106f10 0x7f739010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 --2- 172.21.15.29:0/1298509015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f73901067e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 --2- 172.21.15.29:0/1298509015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390101de0 0x7f73901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 -- 172.21.15.29:0/1298509015 >> 172.21.15.29:0/1298509015 conn(0x7f73900fd8c0 msgr2=0x7f73900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 -- 172.21.15.29:0/1298509015 shutdown_connections 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 -- 172.21.15.29:0/1298509015 wait complete. 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 Processor -- start 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.329+0000 7f7396982640 1 -- start start 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7396982640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7390101de0 0x7f73901983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7396982640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f7390198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7396982640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390106f10 0x7f739019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7396982640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111e20 con 0x7f7390102790 2024-09-19T07:08:44.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7396982640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111ca0 con 0x7f7390101de0 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7396982640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111fa0 con 0x7f7390106f10 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f7390198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f7390198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:52372/0 (socket says 172.21.15.29:52372) 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 -- 172.21.15.29:0/827670843 learned_addr learned my addr 172.21.15.29:0/827670843 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738ffff640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7390101de0 0x7f73901983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7394f1f640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390106f10 0x7f739019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 -- 172.21.15.29:0/827670843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390106f10 msgr2=0x7f739019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390106f10 0x7f739019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 -- 172.21.15.29:0/827670843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7390101de0 msgr2=0x7f73901983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7390101de0 0x7f73901983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 -- 172.21.15.29:0/827670843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739019d370 con 0x7f7390102790 2024-09-19T07:08:44.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f7394f1f640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390106f10 0x7f739019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.330+0000 7f738f7fe640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f7390198900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7384005940 tx=0x7f7384004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.331+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738403f030 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.331+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7384003aa0 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.331+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739019d600 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.331+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384035070 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.331+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901a4f40 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.332+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73901021c0 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.333+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7384042030 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.334+0000 7f738d7fa640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73780a32c0 0x7f73780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.334+0000 7f738ffff640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73780a32c0 0x7f73780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.334+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f73840f0350 con 0x7f7390102790 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.334+0000 7f738ffff640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73780a32c0 0x7f73780a5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f738000bbe0 tx=0x7f738000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:08:44.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.338+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73840bcd80 con 0x7f7390102790 2024-09-19T07:08:44.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.554+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7390199720 con 0x7f7390102790 2024-09-19T07:08:44.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.555+0000 7f738d7fa640 1 -- 172.21.15.29:0/827670843 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+88 (secure 0 0 0) 0x7f7390199720 con 0x7f7390102790 2024-09-19T07:08:44.556 INFO:teuthology.orchestra.run.smithi029.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T07:08:44.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73780a32c0 msgr2=0x7f73780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73780a32c0 0x7f73780a5780 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f738000bbe0 tx=0x7f738000b390 comp rx=0 tx=0).stop 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 msgr2=0x7f7390198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f7390198900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7384005940 tx=0x7f7384004270 comp rx=0 tx=0).stop 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 shutdown_connections 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f73780a32c0 0x7f73780a5780 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7390106f10 0x7f739019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7390102790 0x7f7390198900 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 --2- 172.21.15.29:0/827670843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7390101de0 0x7f73901983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 >> 172.21.15.29:0/827670843 conn(0x7f73900fd8c0 msgr2=0x7f73900fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 shutdown_connections 2024-09-19T07:08:44.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:44.557+0000 7f7396982640 1 -- 172.21.15.29:0/827670843 wait complete. 2024-09-19T07:08:45.327 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T07:08:45.327 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T07:08:45.328 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-19T07:08:45.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:45.328 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:08:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42155sec preferred_lft 42155sec 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2024-09-19T07:08:45.349 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2024-09-19T07:08:45.350 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T07:08:45.350 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:08:45.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:08:45.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:08:45.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:45.499 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T07:08:45.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:45 smithi029 ceph-mon[31255]: pgmap v367: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:45.522 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:45 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/827670843' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:08:45.524 INFO:teuthology.orchestra.run.smithi029.stdout:1 2024-09-19T07:08:45.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:45.526 DEBUG:teuthology.orchestra.run.smithi029:> route 2024-09-19T07:08:45.584 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2024-09-19T07:08:45.584 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T07:08:45.584 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T07:08:45.584 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T07:08:45.584 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T07:08:45.584 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:08:45.584 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:08:45.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T07:08:45.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T07:08:45.585 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T07:08:45.585 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:08:45.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:08:45.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:45 smithi078 ceph-mon[34556]: pgmap v367: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:45.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:45 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/827670843' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:08:45.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:08:45.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:45.717 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-19T07:08:45.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:45 smithi046 ceph-mon[34147]: pgmap v367: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T07:08:45.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:45 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/827670843' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:08:45.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:45.733 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2024-09-19T07:08:45.790 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:08:45.790 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:08:45.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-19T07:08:45.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-19T07:08:45.790 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:08:45.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:08:45.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:08:45.910 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-19T07:08:45.910 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:08:45.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:08:46.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:08:46.028 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:08:46.028 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2024-09-19T07:08:46.028 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2024-09-19T07:08:46.028 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T07:08:46.028 DEBUG:teuthology.orchestra.run.smithi029:> ') 2024-09-19T07:08:46.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:08:46.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:08:46.107 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-19T07:08:46.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:08:46.107 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /tmp/cephfs 2024-09-19T07:08:46.125 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-19T07:08:46.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:08:46.125 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /tmp/cephfs 2024-09-19T07:08:46.181 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-19T07:08:46.248 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T07:08:46.305 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-09-19T07:08:46.306 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T07:08:46.307 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/380678ae24b40c58713f27e79ab23876d8dac81bfc361e2a4d11a6cf89379f40/merged 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d6498f99a7a53c75d3101d65dbb6a359291293f306de33114f3086aad3ceb25c/merged 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/0 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/827dba2d8fc3d10abb58064bb852b0749ef6928b4c1f4527465ca8d4f7f41448/merged 2024-09-19T07:08:46.308 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/cde6d7df95f33d93928e2ec3c302f37b62f660df8a862b0491859e961ffd693c/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/5d098d964ecf65755b2aa7ea58f700fc711b8f48d395598f3777c00e5c676ca9/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/f782ce7ae49b8a6b26265df4ffd8ff74583ce612c28d7f2ccdd95efc807e03a9/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d8b9ab43c81cb249c6ada9dc6152e12e2c98009902409438d3819143ee8e50d7/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/54fedd9d3ad6221aa692ddca9d7d211f3c63d94128cd8b224b11da9cc2174106/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/7d80652ced8e318f76ba6fa155288891cdef892fc1241b8db60eb2729f06296a/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/14a4da5193bcf3787a82b97339c02a03491b7d056e49b32778e1679063a47abf/merged 2024-09-19T07:08:46.309 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-09-19T07:08:46.310 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-19T07:08:46.310 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-19T07:08:46.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:46.310 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-19T07:08:46.363 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T07:08:46.363 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/46994bc4-d517-4df4-8760-45405c51ecc7 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-09-19T07:08:46.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo modprobe fuse 2024-09-19T07:08:46.432 DEBUG:teuthology.orchestra.run.smithi029:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T07:08:46.490 INFO:teuthology.orchestra.run.smithi029.stdout:/proc 2024-09-19T07:08:46.490 INFO:teuthology.orchestra.run.smithi029.stdout:/sys 2024-09-19T07:08:46.490 INFO:teuthology.orchestra.run.smithi029.stdout:/dev 2024-09-19T07:08:46.490 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/security 2024-09-19T07:08:46.491 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/shm 2024-09-19T07:08:46.491 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/pts 2024-09-19T07:08:46.491 INFO:teuthology.orchestra.run.smithi029.stdout:/run 2024-09-19T07:08:46.491 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/cgroup 2024-09-19T07:08:46.491 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/pstore 2024-09-19T07:08:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/bpf 2024-09-19T07:08:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:/ 2024-09-19T07:08:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/selinux 2024-09-19T07:08:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:08:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/mqueue 2024-09-19T07:08:46.492 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/debug 2024-09-19T07:08:46.493 INFO:teuthology.orchestra.run.smithi029.stdout:/dev/hugepages 2024-09-19T07:08:46.493 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/tracing 2024-09-19T07:08:46.493 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T07:08:46.493 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/fs/fuse/connections 2024-09-19T07:08:46.493 INFO:teuthology.orchestra.run.smithi029.stdout:/sys/kernel/config 2024-09-19T07:08:46.493 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T07:08:46.494 INFO:teuthology.orchestra.run.smithi029.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T07:08:46.494 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T07:08:46.494 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/1000 2024-09-19T07:08:46.494 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/ceph 2024-09-19T07:08:46.494 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/380678ae24b40c58713f27e79ab23876d8dac81bfc361e2a4d11a6cf89379f40/merged 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d6498f99a7a53c75d3101d65dbb6a359291293f306de33114f3086aad3ceb25c/merged 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/run/user/0 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/827dba2d8fc3d10abb58064bb852b0749ef6928b4c1f4527465ca8d4f7f41448/merged 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/cde6d7df95f33d93928e2ec3c302f37b62f660df8a862b0491859e961ffd693c/merged 2024-09-19T07:08:46.495 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/5d098d964ecf65755b2aa7ea58f700fc711b8f48d395598f3777c00e5c676ca9/merged 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/f782ce7ae49b8a6b26265df4ffd8ff74583ce612c28d7f2ccdd95efc807e03a9/merged 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/d8b9ab43c81cb249c6ada9dc6152e12e2c98009902409438d3819143ee8e50d7/merged 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/54fedd9d3ad6221aa692ddca9d7d211f3c63d94128cd8b224b11da9cc2174106/merged 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/7d80652ced8e318f76ba6fa155288891cdef892fc1241b8db60eb2729f06296a/merged 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/var/lib/containers/storage/overlay/14a4da5193bcf3787a82b97339c02a03491b7d056e49b32778e1679063a47abf/merged 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-19T07:08:46.496 INFO:teuthology.orchestra.run.smithi029.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-19T07:08:46.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:46.497 DEBUG:teuthology.orchestra.run.smithi029:> ls /sys/fs/fuse/connections 2024-09-19T07:08:46.498 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:2024-09-19T07:08:46.492+0000 7f662f2e7480 -1 init, newargv = 0x564ff2b93f90 newargc=17 2024-09-19T07:08:46.498 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[85149]: starting ceph client 2024-09-19T07:08:46.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[85149]: starting fuse 2024-09-19T07:08:46.514 INFO:teuthology.orchestra.run.smithi029.stdout:120 2024-09-19T07:08:46.514 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> sudo stdin-killer -- python3 -c ' 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> import glob 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> import re 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> import os 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> import subprocess 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> def _find_admin_socket(client_name): 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> files = glob.glob(asok_path) 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> mountpoint = "/tmp/cephfs" 2024-09-19T07:08:46.515 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> # Given a non-glob path, it better be there 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> if "*" not in asok_path: 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> assert(len(files) == 1) 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> return files[0] 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> for f in files: 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> contents = proc_f.read() 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> if mountpoint in contents: 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> return f 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T07:08:46.516 DEBUG:teuthology.orchestra.run.smithi029:> 2024-09-19T07:08:46.517 DEBUG:teuthology.orchestra.run.smithi029:> print(_find_admin_socket("client.0")) 2024-09-19T07:08:46.517 DEBUG:teuthology.orchestra.run.smithi029:> ' 2024-09-19T07:08:46.635 INFO:teuthology.orchestra.run.smithi029.stdout:/var/run/ceph/ceph-client.0.85149.asok 2024-09-19T07:08:46.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:08:46.645 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85149.asok 2024-09-19T07:08:46.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:46.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85149.asok status 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "metadata": { 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "entity_id": "0", 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": "smithi029", 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "mount_point": "/tmp/cephfs", 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "pid": "85149", 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: "root": "/volumes/qa/sv_0/46994bc4-d517-4df4-8760-45405c51ecc7" 2024-09-19T07:08:46.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_count": 0, 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "dentry_pinned_count": 0, 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "id": 15180, 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "inst": { 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "name": { 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "client", 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "num": 15180 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-09-19T07:08:46.785 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 4282408572 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": { 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "192.168.0.1:0", 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 4282408572 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "inst_str": "client.15180 192.168.0.1:0/4282408572", 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "addr_str": "192.168.0.1:0/4282408572", 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "inode_count": 5, 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "mds_epoch": 20, 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch": 92, 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "osd_epoch_barrier": 0, 2024-09-19T07:08:46.786 INFO:teuthology.orchestra.run.smithi029.stdout: "blocklisted": false, 2024-09-19T07:08:46.787 INFO:teuthology.orchestra.run.smithi029.stdout: "fs_name": "cephfs" 2024-09-19T07:08:46.787 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T07:08:46.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:46.792 DEBUG:teuthology.orchestra.run.smithi029:> stat --file-system '--printf=%T 2024-09-19T07:08:46.792 DEBUG:teuthology.orchestra.run.smithi029:> ' -- /tmp/cephfs 2024-09-19T07:08:46.809 INFO:teuthology.orchestra.run.smithi029.stdout:fuseblk 2024-09-19T07:08:46.810 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-09-19T07:08:46.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:08:46.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /tmp/cephfs 2024-09-19T07:08:46.877 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T07:08:46.888 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:08:46.969 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:08:46.969 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T07:08:46.970 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-19T07:08:47.006 INFO:teuthology.orchestra.run.smithi029.stdout:total 0 2024-09-19T07:08:47.017 INFO:teuthology.orchestra.run.smithi029.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-19T07:08:47.017 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-fuse 1.1T 396M 1.1T 1% /tmp/cephfs 2024-09-19T07:08:47.019 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-19T07:08:47.112 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-19T07:08:47.153 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-19T07:08:47.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:47 smithi029 ceph-mon[31255]: pgmap v368: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:47.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:47 smithi078 ceph-mon[34556]: pgmap v368: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:47.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:47 smithi046 ceph-mon[34147]: pgmap v368: 129 pgs: 129 active+clean; 640 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T07:08:49.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-19T07:08:49.364 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-19T07:08:49.366 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-19T07:08:49.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T07:08:49.508 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:49 smithi029 ceph-mon[31255]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T07:08:49.530 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/: 2024-09-19T07:08:49.530 INFO:teuthology.orchestra.run.smithi029.stdout:total 2 2024-09-19T07:08:49.530 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 .. 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 data 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data: 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:08:49.531 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 .. 2024-09-19T07:08:49.533 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-19T07:08:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:[Service] 2024-09-19T07:08:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-19T07:08:49.617 INFO:teuthology.orchestra.run.smithi029.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-19T07:08:49.619 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-19T07:08:49.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:49 smithi078 ceph-mon[34556]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T07:08:49.702 INFO:teuthology.orchestra.run.smithi029.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-19T07:08:49.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:49 smithi046 ceph-mon[34147]: pgmap v369: 129 pgs: 129 active+clean; 647 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T07:08:51.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:51 smithi029 ceph-mon[31255]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 767 B/s wr, 1 op/s 2024-09-19T07:08:51.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:51 smithi078 ceph-mon[34556]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 767 B/s wr, 1 op/s 2024-09-19T07:08:51.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:51 smithi046 ceph-mon[34147]: pgmap v370: 129 pgs: 129 active+clean; 647 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 767 B/s wr, 1 op/s 2024-09-19T07:08:53.551 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:53 smithi046 ceph-mon[34147]: pgmap v371: 129 pgs: 129 active+clean; 4.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 368 KiB/s wr, 4 op/s 2024-09-19T07:08:53.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:53 smithi029 ceph-mon[31255]: pgmap v371: 129 pgs: 129 active+clean; 4.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 368 KiB/s wr, 4 op/s 2024-09-19T07:08:53.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:53 smithi078 ceph-mon[34556]: pgmap v371: 129 pgs: 129 active+clean; 4.9 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 368 KiB/s wr, 4 op/s 2024-09-19T07:08:55.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:55 smithi029 ceph-mon[31255]: pgmap v372: 129 pgs: 129 active+clean; 8.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 668 KiB/s wr, 18 op/s 2024-09-19T07:08:55.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:55 smithi078 ceph-mon[34556]: pgmap v372: 129 pgs: 129 active+clean; 8.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 668 KiB/s wr, 18 op/s 2024-09-19T07:08:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:55 smithi046 ceph-mon[34147]: pgmap v372: 129 pgs: 129 active+clean; 8.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 668 KiB/s wr, 18 op/s 2024-09-19T07:08:57.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:57 smithi029 ceph-mon[31255]: pgmap v373: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.7 MiB/s wr, 46 op/s 2024-09-19T07:08:57.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:57 smithi078 ceph-mon[34556]: pgmap v373: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.7 MiB/s wr, 46 op/s 2024-09-19T07:08:57.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:57 smithi046 ceph-mon[34147]: pgmap v373: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.7 MiB/s wr, 46 op/s 2024-09-19T07:08:59.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:08:59 smithi029 ceph-mon[31255]: pgmap v374: 129 pgs: 129 active+clean; 32 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 3.2 MiB/s wr, 68 op/s 2024-09-19T07:08:59.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:08:59 smithi078 ceph-mon[34556]: pgmap v374: 129 pgs: 129 active+clean; 32 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 3.2 MiB/s wr, 68 op/s 2024-09-19T07:08:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:08:59 smithi046 ceph-mon[34147]: pgmap v374: 129 pgs: 129 active+clean; 32 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 3.2 MiB/s wr, 68 op/s 2024-09-19T07:09:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:01 smithi029 ceph-mon[31255]: pgmap v375: 129 pgs: 129 active+clean; 37 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.1 MiB/s wr, 89 op/s 2024-09-19T07:09:01.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:01 smithi078 ceph-mon[34556]: pgmap v375: 129 pgs: 129 active+clean; 37 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.1 MiB/s wr, 89 op/s 2024-09-19T07:09:01.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:01 smithi046 ceph-mon[34147]: pgmap v375: 129 pgs: 129 active+clean; 37 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.1 MiB/s wr, 89 op/s 2024-09-19T07:09:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:03 smithi029 ceph-mon[31255]: pgmap v376: 129 pgs: 129 active+clean; 40 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.3 MiB/s wr, 96 op/s 2024-09-19T07:09:03.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:03 smithi078 ceph-mon[34556]: pgmap v376: 129 pgs: 129 active+clean; 40 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.3 MiB/s wr, 96 op/s 2024-09-19T07:09:03.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:03 smithi046 ceph-mon[34147]: pgmap v376: 129 pgs: 129 active+clean; 40 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 4.3 MiB/s wr, 96 op/s 2024-09-19T07:09:03.860 INFO:teuthology.orchestra.run.smithi029.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-19T07:09:03.864 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/: 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:total 2 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:08 . 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:08 .. 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 data 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data: 2024-09-19T07:09:04.166 INFO:teuthology.orchestra.run.smithi029.stdout:total 45 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 . 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:08 .. 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 19 07:08 base 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 19 07:08 global 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 log 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_commit_ts 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_dynshmem 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 19 07:08 pg_hba.conf 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 19 07:08 pg_ident.conf 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:09 pg_logical 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 pg_multixact 2024-09-19T07:09:04.167 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_notify 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_replslot 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_serial 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_snapshots 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_stat 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_stat_tmp 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 pg_subtrans 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_tblspc 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_twophase 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:08 PG_VERSION 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:08 pg_wal 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 pg_xact 2024-09-19T07:09:04.168 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 19 07:08 postgresql.auto.conf 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 19 07:08 postgresql.conf 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base: 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:total 3 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 19 07:08 . 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 1 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 13493 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:09 13494 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:total 7778 2024-09-19T07:09:04.169 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 . 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 19 07:08 .. 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 112 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 113 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 1247 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1247_fsm 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1247_vm 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 07:08 1249 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1249_fsm 2024-09-19T07:09:04.170 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1249_vm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 07:08 1255 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1255_fsm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1255_vm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 07:08 1259 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1259_fsm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1259_vm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 07:08 13344 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13344_fsm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13344_vm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13346 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13348 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13349_fsm 2024-09-19T07:09:04.171 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349_vm 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13351 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13353 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13354_fsm 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354_vm 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13356 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13358 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13359_fsm 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359_vm 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13361 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13363 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1417 2024-09-19T07:09:04.172 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1418 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 174 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 175 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2187 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2224 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2328 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2336 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2337 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2579 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2600 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2600_fsm 2024-09-19T07:09:04.173 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2600_vm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2601_fsm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601_vm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2602 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2602_fsm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2602_vm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2603 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2603_fsm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2603_vm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2604 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2605 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2605_fsm 2024-09-19T07:09:04.174 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2605_vm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2606_fsm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606_vm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2607 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2607_fsm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2607_vm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 07:08 2608 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2608_fsm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2608_vm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 07:08 2609 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2609_fsm 2024-09-19T07:09:04.175 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2609_vm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2610 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2610_fsm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2610_vm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2611 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2612_fsm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612_vm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2613 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2615_fsm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615_vm 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2616 2024-09-19T07:09:04.176 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2616_fsm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2616_vm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 07:08 2617 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2617_fsm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2617_vm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 07:08 2618 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2618_fsm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2618_vm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 07:08 2619 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2619_fsm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2619_vm 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2620 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2650 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2651 2024-09-19T07:09:04.177 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2652 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2653 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2654 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2655 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2656 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2657 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 07:08 2658 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 2659 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2660 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2661 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2662 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2663 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2664 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2665 2024-09-19T07:09:04.178 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2666 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2667 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2668 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2669 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2670 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 07:08 2673 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 07:08 2674 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 2675 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2678 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2679 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2680 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2681 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2682 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2683 2024-09-19T07:09:04.179 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2684 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2685 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2686 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2687 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2688 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2689 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 07:08 2690 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 07:08 2691 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2692 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2693 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2696 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2699 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2701 2024-09-19T07:09:04.180 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2702 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2703 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2704 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2753 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2753_fsm 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2753_vm 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2754 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2755 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2756 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2757 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2830 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2831 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2832 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2833 2024-09-19T07:09:04.181 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2834 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2835 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2836 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2837 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 07:08 2838 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2838_fsm 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2838_vm 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2839 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840_fsm 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2840_vm 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2841 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2995 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2996 2024-09-19T07:09:04.182 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3079_fsm 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079_vm 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3080 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3081 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3085 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3118 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3119 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:08 3164 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3256 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3257 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3258 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3350 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3351 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3379 2024-09-19T07:09:04.183 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3380 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3381 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3394 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3394_fsm 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3394_vm 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3395 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3429 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3430 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3431 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3433 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3439 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3440 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3455 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 07:08 3456 2024-09-19T07:09:04.184 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3456_fsm 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3456_vm 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3466 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3467 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3468 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3501 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3502 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3503 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3534 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3541_fsm 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541_vm 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3542 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3574 2024-09-19T07:09:04.185 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3575 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3576 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3596 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3597 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3598 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3599 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3600_fsm 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600_vm 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3601_fsm 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601_vm 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3602_fsm 2024-09-19T07:09:04.186 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602_vm 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603_fsm 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3603_vm 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3604 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3605 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3606 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3607 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3608 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 3609 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3712 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3764_fsm 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764_vm 2024-09-19T07:09:04.187 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3766 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3767 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3997 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4143 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4144 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4145 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4146 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4147 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4148 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4149 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4150 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4151 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4152 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4153 2024-09-19T07:09:04.188 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4154 2024-09-19T07:09:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4155 2024-09-19T07:09:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4156 2024-09-19T07:09:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4157 2024-09-19T07:09:04.189 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4158 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4159 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4160 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4161 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4162 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4163 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4164 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4165 2024-09-19T07:09:04.396 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4166 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4167 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4168 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4169 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4170 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4171 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4172 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4173 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4174 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 5002 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 548 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 549 2024-09-19T07:09:04.397 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6102 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6104 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6106 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6110 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6111 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6112 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6113 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6117 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 826 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 827 2024-09-19T07:09:04.398 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 828 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:08 pg_filenode.map 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:08 PG_VERSION 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:total 7778 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 . 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 19 07:08 .. 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 112 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 113 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 1247 2024-09-19T07:09:04.399 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1247_fsm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1247_vm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 07:08 1249 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1249_fsm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1249_vm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 07:08 1255 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1255_fsm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1255_vm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 07:08 1259 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1259_fsm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1259_vm 2024-09-19T07:09:04.400 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 07:08 13344 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13344_fsm 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13344_vm 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13346 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13348 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13349_fsm 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349_vm 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13351 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13353 2024-09-19T07:09:04.401 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13354_fsm 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354_vm 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13356 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13358 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13359_fsm 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359_vm 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13361 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13363 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1417 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1418 2024-09-19T07:09:04.402 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 174 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 175 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2187 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2224 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2328 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2336 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2337 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2579 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2600 2024-09-19T07:09:04.403 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2600_fsm 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2600_vm 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2601_fsm 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601_vm 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2602 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2602_fsm 2024-09-19T07:09:04.404 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2602_vm 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2603 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2603_fsm 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2603_vm 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2604 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2605 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2605_fsm 2024-09-19T07:09:04.405 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2605_vm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2606_fsm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606_vm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2607 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2607_fsm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2607_vm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 07:08 2608 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2608_fsm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2608_vm 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 07:08 2609 2024-09-19T07:09:04.406 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2609_fsm 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2609_vm 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2610 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2610_fsm 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2610_vm 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2611 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2612_fsm 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612_vm 2024-09-19T07:09:04.407 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2613 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2615_fsm 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615_vm 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2616 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2616_fsm 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2616_vm 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 07:08 2617 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2617_fsm 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2617_vm 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 07:08 2618 2024-09-19T07:09:04.408 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2618_fsm 2024-09-19T07:09:04.409 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2618_vm 2024-09-19T07:09:04.409 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 07:08 2619 2024-09-19T07:09:04.409 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2619_fsm 2024-09-19T07:09:04.409 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2619_vm 2024-09-19T07:09:04.409 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2620 2024-09-19T07:09:04.409 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2650 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2651 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2652 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2653 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2654 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2655 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2656 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2657 2024-09-19T07:09:04.410 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 07:08 2658 2024-09-19T07:09:04.411 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 2659 2024-09-19T07:09:04.411 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2660 2024-09-19T07:09:04.411 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2661 2024-09-19T07:09:04.411 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2662 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2663 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2664 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2665 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2666 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2667 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2668 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2669 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2670 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 07:08 2673 2024-09-19T07:09:04.415 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 07:08 2674 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 2675 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2678 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2679 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2680 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2681 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2682 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2683 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2684 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2685 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2686 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2687 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2688 2024-09-19T07:09:04.416 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2689 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 07:08 2690 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 07:08 2691 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2692 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2693 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2696 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2699 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2701 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2702 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2703 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2704 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2753 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2753_fsm 2024-09-19T07:09:04.417 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2753_vm 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2754 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2755 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2756 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2757 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2830 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2831 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2832 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2833 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2834 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2835 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2836 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2837 2024-09-19T07:09:04.418 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 07:08 2838 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2838_fsm 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2838_vm 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2839 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840_fsm 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2840_vm 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2841 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2995 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2996 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3079_fsm 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079_vm 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3080 2024-09-19T07:09:04.419 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3081 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3085 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3118 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3119 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:08 3164 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3256 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3257 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3258 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3350 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3351 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3379 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3380 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3381 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3394 2024-09-19T07:09:04.420 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3394_fsm 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3394_vm 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3395 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3429 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3430 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3431 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3433 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3439 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3440 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3455 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 07:08 3456 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3456_fsm 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3456_vm 2024-09-19T07:09:04.421 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3466 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3467 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3468 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3501 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3502 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3503 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3534 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3541_fsm 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541_vm 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3542 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3574 2024-09-19T07:09:04.422 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3575 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3576 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3596 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3597 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3598 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3599 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3600_fsm 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600_vm 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3601_fsm 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601_vm 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3602_fsm 2024-09-19T07:09:04.423 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602_vm 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603_fsm 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3603_vm 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3604 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3605 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3606 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3607 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3608 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 3609 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3712 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3764_fsm 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764_vm 2024-09-19T07:09:04.424 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3766 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3767 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3997 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4143 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4144 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4145 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4146 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4147 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4148 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4149 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4150 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4151 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4152 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4153 2024-09-19T07:09:04.425 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4154 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4155 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4156 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4157 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4158 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4159 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4160 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4161 2024-09-19T07:09:04.426 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4162 2024-09-19T07:09:04.628 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4163 2024-09-19T07:09:04.628 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4164 2024-09-19T07:09:04.628 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4165 2024-09-19T07:09:04.628 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4166 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4167 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4168 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4169 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4170 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4171 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4172 2024-09-19T07:09:04.629 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4173 2024-09-19T07:09:04.630 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4174 2024-09-19T07:09:04.630 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 5002 2024-09-19T07:09:04.630 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 548 2024-09-19T07:09:04.630 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 549 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6102 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6104 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6106 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6110 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6111 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6112 2024-09-19T07:09:04.631 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6113 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6117 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 826 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 827 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 828 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:08 pg_filenode.map 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:08 PG_VERSION 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.632 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:total 7778 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:09 . 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 Sep 19 07:08 .. 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 112 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 113 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:09 1247 2024-09-19T07:09:04.633 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1247_fsm 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1247_vm 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 07:09 1249 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1249_fsm 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1249_vm 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 07:08 1255 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 1255_fsm 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1255_vm 2024-09-19T07:09:04.634 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 07:09 1259 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 1259_fsm 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1259_vm 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 07:08 13344 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13344_fsm 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13344_vm 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13346 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13348 2024-09-19T07:09:04.635 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349 2024-09-19T07:09:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13349_fsm 2024-09-19T07:09:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13349_vm 2024-09-19T07:09:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 13351 2024-09-19T07:09:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13353 2024-09-19T07:09:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13354 2024-09-19T07:09:04.636 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13354_fsm 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13354_vm 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13356 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13358 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 13359_fsm 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359_vm 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 13361 2024-09-19T07:09:04.637 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13363 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1417 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 1418 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 174 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 175 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2187 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2224 2024-09-19T07:09:04.638 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2328 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2336 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2337 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2579 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2600 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2600_fsm 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2600_vm 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601 2024-09-19T07:09:04.639 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2601_fsm 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601_vm 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2602 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2602_fsm 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2602_vm 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:09 2603 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2603_fsm 2024-09-19T07:09:04.640 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2603_vm 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2604 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2605 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2605_fsm 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2605_vm 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2606 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2606_fsm 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2606_vm 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2607 2024-09-19T07:09:04.641 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2607_fsm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2607_vm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 07:09 2608 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2608_fsm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2608_vm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 07:08 2609 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2609_fsm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2609_vm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:09 2610 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2610_fsm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2610_vm 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2611 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612 2024-09-19T07:09:04.642 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2612_fsm 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612_vm 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2613 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2615_fsm 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615_vm 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2616 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2616_fsm 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2616_vm 2024-09-19T07:09:04.643 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 07:08 2617 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2617_fsm 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2617_vm 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 07:08 2618 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2618_fsm 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2618_vm 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 07:08 2619 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2619_fsm 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2619_vm 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2620 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2650 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2651 2024-09-19T07:09:04.644 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2652 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 2653 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 2654 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:09 2655 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2656 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2657 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 07:08 2658 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:09 2659 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2660 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2661 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2662 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:09 2663 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2664 2024-09-19T07:09:04.645 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2665 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2666 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2667 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2668 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2669 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2670 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 07:09 2673 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 07:09 2674 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 2675 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2678 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2679 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2680 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2681 2024-09-19T07:09:04.646 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2682 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2683 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2684 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2685 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2686 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2687 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2688 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2689 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 07:09 2690 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 07:09 2691 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2692 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2693 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2696 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2699 2024-09-19T07:09:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2701 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2702 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:09 2703 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 2704 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2753 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2753_fsm 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2753_vm 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2754 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2755 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2756 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2757 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2830 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2831 2024-09-19T07:09:04.648 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2832 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2833 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2834 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2835 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2836 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2837 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 07:09 2838 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2838_fsm 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2838_vm 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2839 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2840 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2840_fsm 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2840_vm 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2841 2024-09-19T07:09:04.649 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2995 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2996 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3079 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3079_fsm 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3079_vm 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3080 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3081 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 3085 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3118 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3119 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:09 3164 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3256 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3257 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3258 2024-09-19T07:09:04.650 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3350 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3351 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3379 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3380 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3381 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3394 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3394_fsm 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3394_vm 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3395 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3429 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3430 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3431 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3433 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3439 2024-09-19T07:09:04.651 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3440 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 3455 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 07:08 3456 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3456_fsm 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3456_vm 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3466 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3467 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3468 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3501 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3502 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3503 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3534 2024-09-19T07:09:04.652 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3541_fsm 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3541_vm 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3542 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3574 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3575 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3576 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3596 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3597 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3598 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3599 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3600_fsm 2024-09-19T07:09:04.653 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600_vm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3601_fsm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3601_vm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3602_fsm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3602_vm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3603 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3603_fsm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3603_vm 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3604 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3605 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3606 2024-09-19T07:09:04.654 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3607 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3608 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 3609 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3712 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3764 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3764_fsm 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3764_vm 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3766 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3767 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3997 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4143 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4144 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4145 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4146 2024-09-19T07:09:04.655 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4147 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4148 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4149 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4150 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4151 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4152 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4153 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4154 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4155 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4156 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4157 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4158 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4159 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4160 2024-09-19T07:09:04.656 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4161 2024-09-19T07:09:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4162 2024-09-19T07:09:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4163 2024-09-19T07:09:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4164 2024-09-19T07:09:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4165 2024-09-19T07:09:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4166 2024-09-19T07:09:04.657 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4167 2024-09-19T07:09:04.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4168 2024-09-19T07:09:04.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4169 2024-09-19T07:09:04.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4170 2024-09-19T07:09:04.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4171 2024-09-19T07:09:04.665 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4172 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4173 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4174 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 5002 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 548 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 549 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6102 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6104 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 6106 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 6110 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 6111 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 6112 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6113 2024-09-19T07:09:04.666 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6117 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 826 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 827 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 828 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:09 pg_filenode.map 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:09 PG_VERSION 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/global: 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:total 538 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 19 07:08 . 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1213 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1213_fsm 2024-09-19T07:09:04.667 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1213_vm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1214 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1214_fsm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1214_vm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 1232 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 1233 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1260 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1260_fsm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1260_vm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1261 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1261_fsm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1261_vm 2024-09-19T07:09:04.668 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 1262 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1262_fsm 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1262_vm 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2396 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2396_fsm 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2396_vm 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2397 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2671 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2672 2024-09-19T07:09:04.669 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2676 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2677 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2694 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2695 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2697 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2698 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2846 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2847 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2964 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2965 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2966 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2967 2024-09-19T07:09:04.670 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3592 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3593 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4060 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4061 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4175 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4176 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4177 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4178 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4181 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4182 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4183 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4184 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4185 2024-09-19T07:09:04.671 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4186 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6000 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6001 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6002 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6100 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6114 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6115 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 pg_control 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:08 pg_filenode.map 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/log: 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.672 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 . 2024-09-19T07:09:04.713 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.713 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.713 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:total 3 2024-09-19T07:09:04.714 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:09 . 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 mappings 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:09 replorigin_checkpoint 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 snapshots 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:09 .. 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.715 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:09 .. 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:total 2 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 . 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 members 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 offsets 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:total 9 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 . 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 .. 2024-09-19T07:09:04.716 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 0000 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:total 9 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 . 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 .. 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 0000 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.717 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.718 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.720 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.721 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-19T07:09:04.729 INFO:teuthology.orchestra.run.smithi029.stdout:total 9 2024-09-19T07:09:04.729 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 . 2024-09-19T07:09:04.729 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 0000 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.730 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:total 16386 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:08 . 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:09 000000010000000000000001 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 archive_status 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:09:04.731 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:08 .. 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout:total 9 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 . 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283102 Sep 19 07:09 .. 2024-09-19T07:09:04.732 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 0000 2024-09-19T07:09:04.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-19T07:09:04.912 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-19T07:09:04.989 INFO:teuthology.orchestra.run.smithi029.stderr:dropping old tables... 2024-09-19T07:09:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-19T07:09:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-19T07:09:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-19T07:09:04.995 INFO:teuthology.orchestra.run.smithi029.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-19T07:09:04.996 INFO:teuthology.orchestra.run.smithi029.stderr:creating tables... 2024-09-19T07:09:05.045 INFO:teuthology.orchestra.run.smithi029.stderr:generating data (client-side)... 2024-09-19T07:09:05.584 INFO:teuthology.orchestra.run.smithi029.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.51 s, remaining 15.91 s) 2024-09-19T07:09:05.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:05 smithi029 ceph-mon[31255]: pgmap v377: 129 pgs: 129 active+clean; 42 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 4.2 MiB/s wr, 99 op/s 2024-09-19T07:09:05.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:05 smithi078 ceph-mon[34556]: pgmap v377: 129 pgs: 129 active+clean; 42 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 4.2 MiB/s wr, 99 op/s 2024-09-19T07:09:05.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:05 smithi046 ceph-mon[34147]: pgmap v377: 129 pgs: 129 active+clean; 42 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 4.2 MiB/s wr, 99 op/s 2024-09-19T07:09:06.752 INFO:teuthology.orchestra.run.smithi029.stderr:200000 of 3200000 tuples (6%) done (elapsed 1.68 s, remaining 25.22 s) 2024-09-19T07:09:07.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:07 smithi029 ceph-mon[31255]: pgmap v378: 129 pgs: 129 active+clean; 48 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 4.9 MiB/s wr, 147 op/s 2024-09-19T07:09:07.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:07 smithi078 ceph-mon[34556]: pgmap v378: 129 pgs: 129 active+clean; 48 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 4.9 MiB/s wr, 147 op/s 2024-09-19T07:09:07.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:07 smithi046 ceph-mon[34147]: pgmap v378: 129 pgs: 129 active+clean; 48 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 4.9 MiB/s wr, 147 op/s 2024-09-19T07:09:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:300000 of 3200000 tuples (9%) done (elapsed 2.87 s, remaining 27.71 s) 2024-09-19T07:09:08.693 INFO:teuthology.orchestra.run.smithi029.stderr:400000 of 3200000 tuples (12%) done (elapsed 3.62 s, remaining 25.35 s) 2024-09-19T07:09:09.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:09 smithi029 ceph-mon[31255]: pgmap v379: 129 pgs: 129 active+clean; 61 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 4.2 MiB/s wr, 135 op/s 2024-09-19T07:09:09.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:09 smithi078 ceph-mon[34556]: pgmap v379: 129 pgs: 129 active+clean; 61 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 4.2 MiB/s wr, 135 op/s 2024-09-19T07:09:09.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:09 smithi046 ceph-mon[34147]: pgmap v379: 129 pgs: 129 active+clean; 61 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 4.2 MiB/s wr, 135 op/s 2024-09-19T07:09:09.836 INFO:teuthology.orchestra.run.smithi029.stderr:500000 of 3200000 tuples (15%) done (elapsed 4.76 s, remaining 25.73 s) 2024-09-19T07:09:10.657 INFO:teuthology.orchestra.run.smithi029.stderr:600000 of 3200000 tuples (18%) done (elapsed 5.59 s, remaining 24.20 s) 2024-09-19T07:09:11.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:11 smithi029 ceph-mon[31255]: pgmap v380: 129 pgs: 129 active+clean; 94 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 9.1 MiB/s wr, 116 op/s 2024-09-19T07:09:11.698 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:11 smithi078 ceph-mon[34556]: pgmap v380: 129 pgs: 129 active+clean; 94 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 9.1 MiB/s wr, 116 op/s 2024-09-19T07:09:11.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:11 smithi046 ceph-mon[34147]: pgmap v380: 129 pgs: 129 active+clean; 94 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 9.1 MiB/s wr, 116 op/s 2024-09-19T07:09:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:700000 of 3200000 tuples (21%) done (elapsed 6.74 s, remaining 24.08 s) 2024-09-19T07:09:12.945 INFO:teuthology.orchestra.run.smithi029.stderr:800000 of 3200000 tuples (25%) done (elapsed 7.87 s, remaining 23.62 s) 2024-09-19T07:09:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:13 smithi029 ceph-mon[31255]: pgmap v381: 129 pgs: 129 active+clean; 151 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 18 MiB/s wr, 101 op/s 2024-09-19T07:09:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:13 smithi078 ceph-mon[34556]: pgmap v381: 129 pgs: 129 active+clean; 151 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 18 MiB/s wr, 101 op/s 2024-09-19T07:09:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:13 smithi046 ceph-mon[34147]: pgmap v381: 129 pgs: 129 active+clean; 151 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 18 MiB/s wr, 101 op/s 2024-09-19T07:09:13.801 INFO:teuthology.orchestra.run.smithi029.stderr:900000 of 3200000 tuples (28%) done (elapsed 8.73 s, remaining 22.31 s) 2024-09-19T07:09:15.050 INFO:teuthology.orchestra.run.smithi029.stderr:1000000 of 3200000 tuples (31%) done (elapsed 9.98 s, remaining 21.95 s) 2024-09-19T07:09:15.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:15 smithi029 ceph-mon[31255]: pgmap v382: 129 pgs: 129 active+clean; 183 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 23 MiB/s wr, 97 op/s 2024-09-19T07:09:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:15 smithi078 ceph-mon[34556]: pgmap v382: 129 pgs: 129 active+clean; 183 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 23 MiB/s wr, 97 op/s 2024-09-19T07:09:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:15 smithi046 ceph-mon[34147]: pgmap v382: 129 pgs: 129 active+clean; 183 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 23 MiB/s wr, 97 op/s 2024-09-19T07:09:16.179 INFO:teuthology.orchestra.run.smithi029.stderr:1100000 of 3200000 tuples (34%) done (elapsed 11.11 s, remaining 21.21 s) 2024-09-19T07:09:16.993 INFO:teuthology.orchestra.run.smithi029.stderr:1200000 of 3200000 tuples (37%) done (elapsed 11.92 s, remaining 19.87 s) 2024-09-19T07:09:17.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:17 smithi029 ceph-mon[31255]: pgmap v383: 129 pgs: 129 active+clean; 245 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 32 MiB/s wr, 95 op/s 2024-09-19T07:09:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:17 smithi078 ceph-mon[34556]: pgmap v383: 129 pgs: 129 active+clean; 245 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 32 MiB/s wr, 95 op/s 2024-09-19T07:09:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:17 smithi046 ceph-mon[34147]: pgmap v383: 129 pgs: 129 active+clean; 245 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 32 MiB/s wr, 95 op/s 2024-09-19T07:09:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:1300000 of 3200000 tuples (40%) done (elapsed 13.06 s, remaining 19.08 s) 2024-09-19T07:09:19.299 INFO:teuthology.orchestra.run.smithi029.stderr:1400000 of 3200000 tuples (43%) done (elapsed 14.23 s, remaining 18.29 s) 2024-09-19T07:09:19.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:19 smithi029 ceph-mon[31255]: pgmap v384: 129 pgs: 129 active+clean; 269 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 35 MiB/s wr, 40 op/s 2024-09-19T07:09:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:19 smithi078 ceph-mon[34556]: pgmap v384: 129 pgs: 129 active+clean; 269 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 35 MiB/s wr, 40 op/s 2024-09-19T07:09:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:19 smithi046 ceph-mon[34147]: pgmap v384: 129 pgs: 129 active+clean; 269 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 35 MiB/s wr, 40 op/s 2024-09-19T07:09:20.298 INFO:teuthology.orchestra.run.smithi029.stderr:1500000 of 3200000 tuples (46%) done (elapsed 15.23 s, remaining 17.26 s) 2024-09-19T07:09:21.451 INFO:teuthology.orchestra.run.smithi029.stderr:1600000 of 3200000 tuples (50%) done (elapsed 16.38 s, remaining 16.38 s) 2024-09-19T07:09:21.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:21 smithi029 ceph-mon[31255]: pgmap v385: 129 pgs: 129 active+clean; 341 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 46 MiB/s wr, 28 op/s 2024-09-19T07:09:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:21 smithi078 ceph-mon[34556]: pgmap v385: 129 pgs: 129 active+clean; 341 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 46 MiB/s wr, 28 op/s 2024-09-19T07:09:21.724 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:21 smithi046 ceph-mon[34147]: pgmap v385: 129 pgs: 129 active+clean; 341 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 46 MiB/s wr, 28 op/s 2024-09-19T07:09:22.177 INFO:teuthology.orchestra.run.smithi029.stderr:1700000 of 3200000 tuples (53%) done (elapsed 17.11 s, remaining 15.09 s) 2024-09-19T07:09:23.351 INFO:teuthology.orchestra.run.smithi029.stderr:1800000 of 3200000 tuples (56%) done (elapsed 18.28 s, remaining 14.22 s) 2024-09-19T07:09:23.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:23 smithi029 ceph-mon[31255]: pgmap v386: 129 pgs: 129 active+clean; 385 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 47 MiB/s wr, 30 op/s 2024-09-19T07:09:23.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:23 smithi078 ceph-mon[34556]: pgmap v386: 129 pgs: 129 active+clean; 385 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 47 MiB/s wr, 30 op/s 2024-09-19T07:09:23.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:23 smithi046 ceph-mon[34147]: pgmap v386: 129 pgs: 129 active+clean; 385 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 47 MiB/s wr, 30 op/s 2024-09-19T07:09:24.494 INFO:teuthology.orchestra.run.smithi029.stderr:1900000 of 3200000 tuples (59%) done (elapsed 19.42 s, remaining 13.29 s) 2024-09-19T07:09:25.319 INFO:teuthology.orchestra.run.smithi029.stderr:2000000 of 3200000 tuples (62%) done (elapsed 20.25 s, remaining 12.15 s) 2024-09-19T07:09:25.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:25 smithi029 ceph-mon[31255]: pgmap v387: 129 pgs: 129 active+clean; 409 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 41 MiB/s wr, 25 op/s 2024-09-19T07:09:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:25 smithi078 ceph-mon[34556]: pgmap v387: 129 pgs: 129 active+clean; 409 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 41 MiB/s wr, 25 op/s 2024-09-19T07:09:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:25 smithi046 ceph-mon[34147]: pgmap v387: 129 pgs: 129 active+clean; 409 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 41 MiB/s wr, 25 op/s 2024-09-19T07:09:26.438 INFO:teuthology.orchestra.run.smithi029.stderr:2100000 of 3200000 tuples (65%) done (elapsed 21.37 s, remaining 11.19 s) 2024-09-19T07:09:27.607 INFO:teuthology.orchestra.run.smithi029.stderr:2200000 of 3200000 tuples (68%) done (elapsed 22.54 s, remaining 10.24 s) 2024-09-19T07:09:27.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:27 smithi029 ceph-mon[31255]: pgmap v388: 129 pgs: 129 active+clean; 445 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 43 MiB/s wr, 25 op/s 2024-09-19T07:09:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:27 smithi078 ceph-mon[34556]: pgmap v388: 129 pgs: 129 active+clean; 445 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 43 MiB/s wr, 25 op/s 2024-09-19T07:09:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:27 smithi046 ceph-mon[34147]: pgmap v388: 129 pgs: 129 active+clean; 445 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 43 MiB/s wr, 25 op/s 2024-09-19T07:09:28.447 INFO:teuthology.orchestra.run.smithi029.stderr:2300000 of 3200000 tuples (71%) done (elapsed 23.38 s, remaining 9.15 s) 2024-09-19T07:09:29.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:29 smithi029 ceph-mon[31255]: pgmap v389: 129 pgs: 129 active+clean; 482 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 40 MiB/s wr, 28 op/s 2024-09-19T07:09:29.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:29.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:29.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:29 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:29.684 INFO:teuthology.orchestra.run.smithi029.stderr:2400000 of 3200000 tuples (75%) done (elapsed 24.61 s, remaining 8.20 s) 2024-09-19T07:09:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:29 smithi078 ceph-mon[34556]: pgmap v389: 129 pgs: 129 active+clean; 482 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 40 MiB/s wr, 28 op/s 2024-09-19T07:09:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:29 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:29 smithi046 ceph-mon[34147]: pgmap v389: 129 pgs: 129 active+clean; 482 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 40 MiB/s wr, 28 op/s 2024-09-19T07:09:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:29 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:30.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:30.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:30.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:30.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:30.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:30.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:30.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:30.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:30.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:09:30.856 INFO:teuthology.orchestra.run.smithi029.stderr:2500000 of 3200000 tuples (78%) done (elapsed 25.78 s, remaining 7.22 s) 2024-09-19T07:09:31.638 INFO:teuthology.orchestra.run.smithi029.stderr:2600000 of 3200000 tuples (81%) done (elapsed 26.57 s, remaining 6.13 s) 2024-09-19T07:09:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:31 smithi078 ceph-mon[34556]: pgmap v390: 129 pgs: 129 active+clean; 570 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 50 MiB/s wr, 26 op/s 2024-09-19T07:09:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:31 smithi046 ceph-mon[34147]: pgmap v390: 129 pgs: 129 active+clean; 570 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 50 MiB/s wr, 26 op/s 2024-09-19T07:09:32.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:31 smithi029 ceph-mon[31255]: pgmap v390: 129 pgs: 129 active+clean; 570 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 50 MiB/s wr, 26 op/s 2024-09-19T07:09:32.801 INFO:teuthology.orchestra.run.smithi029.stderr:2700000 of 3200000 tuples (84%) done (elapsed 27.73 s, remaining 5.14 s) 2024-09-19T07:09:33.604 INFO:teuthology.orchestra.run.smithi029.stderr:2800000 of 3200000 tuples (87%) done (elapsed 28.53 s, remaining 4.08 s) 2024-09-19T07:09:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:33 smithi078 ceph-mon[34556]: pgmap v391: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 43 MiB/s wr, 27 op/s 2024-09-19T07:09:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:33 smithi046 ceph-mon[34147]: pgmap v391: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 43 MiB/s wr, 27 op/s 2024-09-19T07:09:34.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:33 smithi029 ceph-mon[31255]: pgmap v391: 129 pgs: 129 active+clean; 598 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 43 MiB/s wr, 27 op/s 2024-09-19T07:09:34.749 INFO:teuthology.orchestra.run.smithi029.stderr:2900000 of 3200000 tuples (90%) done (elapsed 29.68 s, remaining 3.07 s) 2024-09-19T07:09:35.876 INFO:teuthology.orchestra.run.smithi029.stderr:3000000 of 3200000 tuples (93%) done (elapsed 30.81 s, remaining 2.05 s) 2024-09-19T07:09:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:35 smithi078 ceph-mon[34556]: pgmap v392: 129 pgs: 129 active+clean; 630 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 41 MiB/s wr, 23 op/s 2024-09-19T07:09:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:35 smithi046 ceph-mon[34147]: pgmap v392: 129 pgs: 129 active+clean; 630 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 41 MiB/s wr, 23 op/s 2024-09-19T07:09:36.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:35 smithi029 ceph-mon[31255]: pgmap v392: 129 pgs: 129 active+clean; 630 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 41 MiB/s wr, 23 op/s 2024-09-19T07:09:36.706 INFO:teuthology.orchestra.run.smithi029.stderr:3100000 of 3200000 tuples (96%) done (elapsed 31.64 s, remaining 1.02 s) 2024-09-19T07:09:37.905 INFO:teuthology.orchestra.run.smithi029.stderr:3200000 of 3200000 tuples (100%) done (elapsed 32.83 s, remaining 0.00 s) 2024-09-19T07:09:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:37 smithi046 ceph-mon[34147]: pgmap v393: 129 pgs: 129 active+clean; 698 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 MiB/s wr, 25 op/s 2024-09-19T07:09:37.979 INFO:teuthology.orchestra.run.smithi029.stderr:vacuuming... 2024-09-19T07:09:38.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:37 smithi029 ceph-mon[31255]: pgmap v393: 129 pgs: 129 active+clean; 698 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 MiB/s wr, 25 op/s 2024-09-19T07:09:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:37 smithi078 ceph-mon[34556]: pgmap v393: 129 pgs: 129 active+clean; 698 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 MiB/s wr, 25 op/s 2024-09-19T07:09:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:39 smithi046 ceph-mon[34147]: pgmap v394: 129 pgs: 129 active+clean; 714 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 45 MiB/s wr, 28 op/s 2024-09-19T07:09:40.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:39 smithi029 ceph-mon[31255]: pgmap v394: 129 pgs: 129 active+clean; 714 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 45 MiB/s wr, 28 op/s 2024-09-19T07:09:40.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:39 smithi078 ceph-mon[34556]: pgmap v394: 129 pgs: 129 active+clean; 714 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 45 MiB/s wr, 28 op/s 2024-09-19T07:09:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:41 smithi046 ceph-mon[34147]: pgmap v395: 129 pgs: 129 active+clean; 754 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 MiB/s wr, 25 op/s 2024-09-19T07:09:42.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:41 smithi029 ceph-mon[31255]: pgmap v395: 129 pgs: 129 active+clean; 754 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 MiB/s wr, 25 op/s 2024-09-19T07:09:42.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:41 smithi078 ceph-mon[34556]: pgmap v395: 129 pgs: 129 active+clean; 754 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 48 MiB/s wr, 25 op/s 2024-09-19T07:09:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:43 smithi046 ceph-mon[34147]: pgmap v396: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 44 MiB/s wr, 29 op/s 2024-09-19T07:09:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:43 smithi029 ceph-mon[31255]: pgmap v396: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 44 MiB/s wr, 29 op/s 2024-09-19T07:09:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:43 smithi078 ceph-mon[34556]: pgmap v396: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 44 MiB/s wr, 29 op/s 2024-09-19T07:09:45.867 INFO:teuthology.orchestra.run.smithi029.stderr:creating primary keys... 2024-09-19T07:09:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:45 smithi046 ceph-mon[34147]: pgmap v397: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 46 MiB/s wr, 26 op/s 2024-09-19T07:09:46.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:45 smithi029 ceph-mon[31255]: pgmap v397: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 46 MiB/s wr, 26 op/s 2024-09-19T07:09:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:45 smithi078 ceph-mon[34556]: pgmap v397: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 46 MiB/s wr, 26 op/s 2024-09-19T07:09:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:47 smithi046 ceph-mon[34147]: pgmap v398: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 27 op/s 2024-09-19T07:09:48.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:47 smithi029 ceph-mon[31255]: pgmap v398: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 27 op/s 2024-09-19T07:09:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:47 smithi078 ceph-mon[34556]: pgmap v398: 129 pgs: 129 active+clean; 780 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 51 MiB/s wr, 27 op/s 2024-09-19T07:09:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:49 smithi046 ceph-mon[34147]: pgmap v399: 129 pgs: 129 active+clean; 796 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 44 MiB/s wr, 31 op/s 2024-09-19T07:09:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:49 smithi029 ceph-mon[31255]: pgmap v399: 129 pgs: 129 active+clean; 796 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 44 MiB/s wr, 31 op/s 2024-09-19T07:09:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:49 smithi078 ceph-mon[34556]: pgmap v399: 129 pgs: 129 active+clean; 796 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 44 MiB/s wr, 31 op/s 2024-09-19T07:09:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:51 smithi046 ceph-mon[34147]: pgmap v400: 129 pgs: 129 active+clean; 862 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 MiB/s wr, 31 op/s 2024-09-19T07:09:52.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:51 smithi029 ceph-mon[31255]: pgmap v400: 129 pgs: 129 active+clean; 862 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 MiB/s wr, 31 op/s 2024-09-19T07:09:52.178 INFO:teuthology.orchestra.run.smithi029.stderr:done in 47.19 s (drop tables 0.01 s, create tables 0.05 s, client-side generate 32.93 s, vacuum 7.89 s, primary keys 6.31 s). 2024-09-19T07:09:52.182 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-19T07:09:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:51 smithi078 ceph-mon[34556]: pgmap v400: 129 pgs: 129 active+clean; 862 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 MiB/s wr, 31 op/s 2024-09-19T07:09:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:starting vacuum...end. 2024-09-19T07:09:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:53 smithi046 ceph-mon[34147]: pgmap v401: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 34 op/s 2024-09-19T07:09:53.997 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:53 smithi078 ceph-mon[34556]: pgmap v401: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 34 op/s 2024-09-19T07:09:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:53 smithi029 ceph-mon[31255]: pgmap v401: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 52 MiB/s wr, 34 op/s 2024-09-19T07:09:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:55 smithi046 ceph-mon[34147]: pgmap v402: 129 pgs: 129 active+clean; 946 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 MiB/s wr, 51 op/s 2024-09-19T07:09:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:55 smithi029 ceph-mon[31255]: pgmap v402: 129 pgs: 129 active+clean; 946 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 MiB/s wr, 51 op/s 2024-09-19T07:09:56.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:55 smithi078 ceph-mon[34556]: pgmap v402: 129 pgs: 129 active+clean; 946 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 MiB/s wr, 51 op/s 2024-09-19T07:09:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 5.0 s, 1547.8 tps, lat 60.302 ms stddev 75.283 2024-09-19T07:09:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:57 smithi046 ceph-mon[34147]: pgmap v403: 129 pgs: 129 active+clean; 961 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 46 MiB/s wr, 52 op/s 2024-09-19T07:09:58.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:57 smithi029 ceph-mon[31255]: pgmap v403: 129 pgs: 129 active+clean; 961 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 46 MiB/s wr, 52 op/s 2024-09-19T07:09:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:57 smithi078 ceph-mon[34556]: pgmap v403: 129 pgs: 129 active+clean; 961 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 46 MiB/s wr, 52 op/s 2024-09-19T07:09:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:09:59 smithi046 ceph-mon[34147]: pgmap v404: 129 pgs: 129 active+clean; 954 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 37 MiB/s wr, 56 op/s 2024-09-19T07:10:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:09:59 smithi029 ceph-mon[31255]: pgmap v404: 129 pgs: 129 active+clean; 954 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 37 MiB/s wr, 56 op/s 2024-09-19T07:10:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:09:59 smithi078 ceph-mon[34556]: pgmap v404: 129 pgs: 129 active+clean; 954 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 37 MiB/s wr, 56 op/s 2024-09-19T07:10:01.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:00 smithi029 ceph-mon[31255]: overall HEALTH_OK 2024-09-19T07:10:01.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:00 smithi078 ceph-mon[34556]: overall HEALTH_OK 2024-09-19T07:10:01.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:00 smithi046 ceph-mon[34147]: overall HEALTH_OK 2024-09-19T07:10:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:01 smithi029 ceph-mon[31255]: pgmap v405: 129 pgs: 129 active+clean; 936 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 33 MiB/s wr, 155 op/s 2024-09-19T07:10:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:01 smithi078 ceph-mon[34556]: pgmap v405: 129 pgs: 129 active+clean; 936 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 33 MiB/s wr, 155 op/s 2024-09-19T07:10:02.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:01 smithi046 ceph-mon[34147]: pgmap v405: 129 pgs: 129 active+clean; 936 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 33 MiB/s wr, 155 op/s 2024-09-19T07:10:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 10.0 s, 1192.0 tps, lat 83.503 ms stddev 37.626 2024-09-19T07:10:04.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:03 smithi029 ceph-mon[31255]: pgmap v406: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 20 MiB/s wr, 279 op/s 2024-09-19T07:10:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:03 smithi078 ceph-mon[34556]: pgmap v406: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 20 MiB/s wr, 279 op/s 2024-09-19T07:10:04.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:03 smithi046 ceph-mon[34147]: pgmap v406: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 20 MiB/s wr, 279 op/s 2024-09-19T07:10:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:05 smithi029 ceph-mon[31255]: pgmap v407: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 16 MiB/s wr, 387 op/s 2024-09-19T07:10:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:05 smithi078 ceph-mon[34556]: pgmap v407: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 16 MiB/s wr, 387 op/s 2024-09-19T07:10:06.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:05 smithi046 ceph-mon[34147]: pgmap v407: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 16 MiB/s wr, 387 op/s 2024-09-19T07:10:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 15.0 s, 1006.8 tps, lat 99.525 ms stddev 58.830 2024-09-19T07:10:08.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:07 smithi029 ceph-mon[31255]: pgmap v408: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 674 op/s 2024-09-19T07:10:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:07 smithi078 ceph-mon[34556]: pgmap v408: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 674 op/s 2024-09-19T07:10:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:07 smithi046 ceph-mon[34147]: pgmap v408: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 674 op/s 2024-09-19T07:10:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:09 smithi029 ceph-mon[31255]: pgmap v409: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.1 MiB/s wr, 778 op/s 2024-09-19T07:10:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:09 smithi078 ceph-mon[34556]: pgmap v409: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.1 MiB/s wr, 778 op/s 2024-09-19T07:10:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:09 smithi046 ceph-mon[34147]: pgmap v409: 129 pgs: 129 active+clean; 936 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.1 MiB/s wr, 778 op/s 2024-09-19T07:10:12.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:11 smithi029 ceph-mon[31255]: pgmap v410: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-09-19T07:10:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:11 smithi078 ceph-mon[34556]: pgmap v410: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-09-19T07:10:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:11 smithi046 ceph-mon[34147]: pgmap v410: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2024-09-19T07:10:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 20.0 s, 1146.8 tps, lat 87.010 ms stddev 37.432 2024-09-19T07:10:14.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:13 smithi029 ceph-mon[31255]: pgmap v411: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:10:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:13 smithi078 ceph-mon[34556]: pgmap v411: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:10:14.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:13 smithi046 ceph-mon[34147]: pgmap v411: 129 pgs: 129 active+clean; 936 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:10:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:15 smithi029 ceph-mon[31255]: pgmap v412: 129 pgs: 129 active+clean; 936 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:10:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:15 smithi078 ceph-mon[34556]: pgmap v412: 129 pgs: 129 active+clean; 936 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:10:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:15 smithi046 ceph-mon[34147]: pgmap v412: 129 pgs: 129 active+clean; 936 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:10:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 25.0 s, 1087.0 tps, lat 91.979 ms stddev 34.672 2024-09-19T07:10:18.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:17 smithi029 ceph-mon[31255]: pgmap v413: 129 pgs: 129 active+clean; 936 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.37k op/s 2024-09-19T07:10:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:17 smithi078 ceph-mon[34556]: pgmap v413: 129 pgs: 129 active+clean; 936 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.37k op/s 2024-09-19T07:10:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:17 smithi046 ceph-mon[34147]: pgmap v413: 129 pgs: 129 active+clean; 936 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.37k op/s 2024-09-19T07:10:20.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:19 smithi029 ceph-mon[31255]: pgmap v414: 129 pgs: 129 active+clean; 937 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.9 MiB/s wr, 1.18k op/s 2024-09-19T07:10:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:19 smithi078 ceph-mon[34556]: pgmap v414: 129 pgs: 129 active+clean; 937 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.9 MiB/s wr, 1.18k op/s 2024-09-19T07:10:20.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:19 smithi046 ceph-mon[34147]: pgmap v414: 129 pgs: 129 active+clean; 937 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.9 MiB/s wr, 1.18k op/s 2024-09-19T07:10:22.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:21 smithi029 ceph-mon[31255]: pgmap v415: 129 pgs: 129 active+clean; 937 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 1.39k op/s 2024-09-19T07:10:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:21 smithi078 ceph-mon[34556]: pgmap v415: 129 pgs: 129 active+clean; 937 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 1.39k op/s 2024-09-19T07:10:22.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:21 smithi046 ceph-mon[34147]: pgmap v415: 129 pgs: 129 active+clean; 937 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 1.39k op/s 2024-09-19T07:10:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 30.0 s, 567.0 tps, lat 107.409 ms stddev 119.911 2024-09-19T07:10:24.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:23 smithi029 ceph-mon[31255]: pgmap v416: 129 pgs: 129 active+clean; 945 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:10:24.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:23 smithi078 ceph-mon[34556]: pgmap v416: 129 pgs: 129 active+clean; 945 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:10:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:23 smithi046 ceph-mon[34147]: pgmap v416: 129 pgs: 129 active+clean; 945 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:10:25.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:25 smithi078 ceph-mon[34556]: pgmap v417: 129 pgs: 129 active+clean; 949 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.13k op/s 2024-09-19T07:10:26.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:25 smithi029 ceph-mon[31255]: pgmap v417: 129 pgs: 129 active+clean; 949 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.13k op/s 2024-09-19T07:10:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:25 smithi046 ceph-mon[34147]: pgmap v417: 129 pgs: 129 active+clean; 949 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.13k op/s 2024-09-19T07:10:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 35.0 s, 1074.4 tps, lat 127.988 ms stddev 275.785 2024-09-19T07:10:28.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:27 smithi029 ceph-mon[31255]: pgmap v418: 129 pgs: 129 active+clean; 953 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-19T07:10:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:27 smithi078 ceph-mon[34556]: pgmap v418: 129 pgs: 129 active+clean; 953 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-19T07:10:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:27 smithi046 ceph-mon[34147]: pgmap v418: 129 pgs: 129 active+clean; 953 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-19T07:10:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:29 smithi029 ceph-mon[31255]: pgmap v419: 129 pgs: 129 active+clean; 953 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.4 MiB/s wr, 949 op/s 2024-09-19T07:10:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:29 smithi078 ceph-mon[34556]: pgmap v419: 129 pgs: 129 active+clean; 953 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.4 MiB/s wr, 949 op/s 2024-09-19T07:10:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:29 smithi046 ceph-mon[34147]: pgmap v419: 129 pgs: 129 active+clean; 953 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.4 MiB/s wr, 949 op/s 2024-09-19T07:10:31.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:31.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:31.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:31.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:30 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:31.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:31.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:31.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:30 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:31.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:30 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:10:32.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:31 smithi029 ceph-mon[31255]: pgmap v420: 129 pgs: 129 active+clean; 956 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-19T07:10:32.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:31 smithi078 ceph-mon[34556]: pgmap v420: 129 pgs: 129 active+clean; 956 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-19T07:10:32.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:31 smithi046 ceph-mon[34147]: pgmap v420: 129 pgs: 129 active+clean; 956 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-19T07:10:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 40.0 s, 947.2 tps, lat 107.572 ms stddev 93.375 2024-09-19T07:10:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:33 smithi029 ceph-mon[31255]: pgmap v421: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 1.00k op/s 2024-09-19T07:10:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:33 smithi078 ceph-mon[34556]: pgmap v421: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 1.00k op/s 2024-09-19T07:10:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:33 smithi046 ceph-mon[34147]: pgmap v421: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 1.00k op/s 2024-09-19T07:10:36.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:35 smithi029 ceph-mon[31255]: pgmap v422: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 975 op/s 2024-09-19T07:10:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:35 smithi078 ceph-mon[34556]: pgmap v422: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 975 op/s 2024-09-19T07:10:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:35 smithi046 ceph-mon[34147]: pgmap v422: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 975 op/s 2024-09-19T07:10:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 45.0 s, 1154.4 tps, lat 86.425 ms stddev 86.926 2024-09-19T07:10:38.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:37 smithi029 ceph-mon[31255]: pgmap v423: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:10:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:37 smithi078 ceph-mon[34556]: pgmap v423: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:10:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:37 smithi046 ceph-mon[34147]: pgmap v423: 129 pgs: 129 active+clean; 956 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:10:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:39 smithi029 ceph-mon[31255]: pgmap v424: 129 pgs: 129 active+clean; 958 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-09-19T07:10:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:39 smithi078 ceph-mon[34556]: pgmap v424: 129 pgs: 129 active+clean; 958 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-09-19T07:10:40.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:39 smithi046 ceph-mon[34147]: pgmap v424: 129 pgs: 129 active+clean; 958 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 10 MiB/s wr, 1.16k op/s 2024-09-19T07:10:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:41 smithi029 ceph-mon[31255]: pgmap v425: 129 pgs: 129 active+clean; 960 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 1.34k op/s 2024-09-19T07:10:42.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:41 smithi078 ceph-mon[34556]: pgmap v425: 129 pgs: 129 active+clean; 960 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 1.34k op/s 2024-09-19T07:10:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:41 smithi046 ceph-mon[34147]: pgmap v425: 129 pgs: 129 active+clean; 960 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 1.34k op/s 2024-09-19T07:10:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 50.0 s, 1014.8 tps, lat 98.550 ms stddev 77.218 2024-09-19T07:10:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:43 smithi029 ceph-mon[31255]: pgmap v426: 129 pgs: 129 active+clean; 960 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.28k op/s 2024-09-19T07:10:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:43 smithi078 ceph-mon[34556]: pgmap v426: 129 pgs: 129 active+clean; 960 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.28k op/s 2024-09-19T07:10:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:43 smithi046 ceph-mon[34147]: pgmap v426: 129 pgs: 129 active+clean; 960 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.28k op/s 2024-09-19T07:10:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:45 smithi029 ceph-mon[31255]: pgmap v427: 129 pgs: 129 active+clean; 960 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-19T07:10:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:45 smithi078 ceph-mon[34556]: pgmap v427: 129 pgs: 129 active+clean; 960 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-19T07:10:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:45 smithi046 ceph-mon[34147]: pgmap v427: 129 pgs: 129 active+clean; 960 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-19T07:10:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 55.0 s, 1029.7 tps, lat 96.970 ms stddev 55.302 2024-09-19T07:10:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:47 smithi029 ceph-mon[31255]: pgmap v428: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 1.27k op/s 2024-09-19T07:10:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:47 smithi078 ceph-mon[34556]: pgmap v428: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 1.27k op/s 2024-09-19T07:10:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:47 smithi046 ceph-mon[34147]: pgmap v428: 129 pgs: 129 active+clean; 960 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 1.27k op/s 2024-09-19T07:10:50.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:49 smithi029 ceph-mon[31255]: pgmap v429: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-19T07:10:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:49 smithi078 ceph-mon[34556]: pgmap v429: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-19T07:10:50.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:49 smithi046 ceph-mon[34147]: pgmap v429: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-19T07:10:52.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:51 smithi029 ceph-mon[31255]: pgmap v430: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-19T07:10:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:51 smithi078 ceph-mon[34556]: pgmap v430: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-19T07:10:52.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:51 smithi046 ceph-mon[34147]: pgmap v430: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-19T07:10:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 60.0 s, 969.5 tps, lat 99.732 ms stddev 46.126 2024-09-19T07:10:53.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:52 smithi078 ceph-mon[34556]: pgmap v431: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-19T07:10:53.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:52 smithi046 ceph-mon[34147]: pgmap v431: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-19T07:10:53.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:52 smithi029 ceph-mon[31255]: pgmap v431: 129 pgs: 129 active+clean; 960 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.2 MiB/s wr, 1.08k op/s 2024-09-19T07:10:55.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:54 smithi029 ceph-mon[31255]: pgmap v432: 129 pgs: 129 active+clean; 960 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9.1 MiB/s wr, 1.08k op/s 2024-09-19T07:10:55.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:54 smithi078 ceph-mon[34556]: pgmap v432: 129 pgs: 129 active+clean; 960 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9.1 MiB/s wr, 1.08k op/s 2024-09-19T07:10:55.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:54 smithi046 ceph-mon[34147]: pgmap v432: 129 pgs: 129 active+clean; 960 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9.1 MiB/s wr, 1.08k op/s 2024-09-19T07:10:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 65.0 s, 988.8 tps, lat 102.776 ms stddev 102.368 2024-09-19T07:10:57.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:56 smithi029 ceph-mon[31255]: pgmap v433: 129 pgs: 129 active+clean; 960 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-19T07:10:57.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:56 smithi078 ceph-mon[34556]: pgmap v433: 129 pgs: 129 active+clean; 960 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-19T07:10:57.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:56 smithi046 ceph-mon[34147]: pgmap v433: 129 pgs: 129 active+clean; 960 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-19T07:10:59.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:10:58 smithi029 ceph-mon[31255]: pgmap v434: 129 pgs: 129 active+clean; 964 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.4 MiB/s wr, 1.07k op/s 2024-09-19T07:10:59.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:10:58 smithi078 ceph-mon[34556]: pgmap v434: 129 pgs: 129 active+clean; 964 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.4 MiB/s wr, 1.07k op/s 2024-09-19T07:10:59.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:10:58 smithi046 ceph-mon[34147]: pgmap v434: 129 pgs: 129 active+clean; 964 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.4 MiB/s wr, 1.07k op/s 2024-09-19T07:11:01.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:00 smithi029 ceph-mon[31255]: pgmap v435: 129 pgs: 129 active+clean; 976 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 1.22k op/s 2024-09-19T07:11:01.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:00 smithi078 ceph-mon[34556]: pgmap v435: 129 pgs: 129 active+clean; 976 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 1.22k op/s 2024-09-19T07:11:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:00 smithi046 ceph-mon[34147]: pgmap v435: 129 pgs: 129 active+clean; 976 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 1.22k op/s 2024-09-19T07:11:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 70.0 s, 1150.6 tps, lat 87.258 ms stddev 28.741 2024-09-19T07:11:03.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:02 smithi029 ceph-mon[31255]: pgmap v436: 129 pgs: 129 active+clean; 976 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:11:03.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:02 smithi078 ceph-mon[34556]: pgmap v436: 129 pgs: 129 active+clean; 976 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:11:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:02 smithi046 ceph-mon[34147]: pgmap v436: 129 pgs: 129 active+clean; 976 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:11:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:04 smithi029 ceph-mon[31255]: pgmap v437: 129 pgs: 129 active+clean; 977 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.25k op/s 2024-09-19T07:11:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:04 smithi078 ceph-mon[34556]: pgmap v437: 129 pgs: 129 active+clean; 977 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.25k op/s 2024-09-19T07:11:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:04 smithi046 ceph-mon[34147]: pgmap v437: 129 pgs: 129 active+clean; 977 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.25k op/s 2024-09-19T07:11:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 75.0 s, 1014.8 tps, lat 99.983 ms stddev 60.835 2024-09-19T07:11:07.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:06 smithi029 ceph-mon[31255]: pgmap v438: 129 pgs: 129 active+clean; 977 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:11:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:06 smithi078 ceph-mon[34556]: pgmap v438: 129 pgs: 129 active+clean; 977 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:11:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:06 smithi046 ceph-mon[34147]: pgmap v438: 129 pgs: 129 active+clean; 977 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 1.19k op/s 2024-09-19T07:11:09.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:09 smithi029 ceph-mon[31255]: pgmap v439: 129 pgs: 129 active+clean; 977 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-19T07:11:09.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:09 smithi078 ceph-mon[34556]: pgmap v439: 129 pgs: 129 active+clean; 977 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-19T07:11:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:09 smithi046 ceph-mon[34147]: pgmap v439: 129 pgs: 129 active+clean; 977 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 1.15k op/s 2024-09-19T07:11:11.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:11 smithi029 ceph-mon[31255]: pgmap v440: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 1.30k op/s 2024-09-19T07:11:11.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:11 smithi078 ceph-mon[34556]: pgmap v440: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 1.30k op/s 2024-09-19T07:11:11.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:11 smithi046 ceph-mon[34147]: pgmap v440: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 1.30k op/s 2024-09-19T07:11:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 80.0 s, 994.2 tps, lat 100.639 ms stddev 89.591 2024-09-19T07:11:13.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:13 smithi029 ceph-mon[31255]: pgmap v441: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.1 MiB/s wr, 1.07k op/s 2024-09-19T07:11:13.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:13 smithi078 ceph-mon[34556]: pgmap v441: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.1 MiB/s wr, 1.07k op/s 2024-09-19T07:11:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:13 smithi046 ceph-mon[34147]: pgmap v441: 129 pgs: 129 active+clean; 977 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.1 MiB/s wr, 1.07k op/s 2024-09-19T07:11:15.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:15 smithi029 ceph-mon[31255]: pgmap v442: 129 pgs: 129 active+clean; 977 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:11:15.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:15 smithi078 ceph-mon[34556]: pgmap v442: 129 pgs: 129 active+clean; 977 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:11:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:15 smithi046 ceph-mon[34147]: pgmap v442: 129 pgs: 129 active+clean; 977 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:11:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 85.0 s, 1210.6 tps, lat 82.556 ms stddev 28.369 2024-09-19T07:11:17.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:17 smithi029 ceph-mon[31255]: pgmap v443: 129 pgs: 129 active+clean; 977 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:11:17.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:17 smithi078 ceph-mon[34556]: pgmap v443: 129 pgs: 129 active+clean; 977 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:11:17.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:17 smithi046 ceph-mon[34147]: pgmap v443: 129 pgs: 129 active+clean; 977 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:11:19.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:19 smithi029 ceph-mon[31255]: pgmap v444: 129 pgs: 129 active+clean; 977 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.7 MiB/s wr, 1.14k op/s 2024-09-19T07:11:19.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:19 smithi078 ceph-mon[34556]: pgmap v444: 129 pgs: 129 active+clean; 977 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.7 MiB/s wr, 1.14k op/s 2024-09-19T07:11:19.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:19 smithi046 ceph-mon[34147]: pgmap v444: 129 pgs: 129 active+clean; 977 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.7 MiB/s wr, 1.14k op/s 2024-09-19T07:11:21.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:21 smithi029 ceph-mon[31255]: pgmap v445: 129 pgs: 129 active+clean; 977 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 1.38k op/s 2024-09-19T07:11:21.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:21 smithi078 ceph-mon[34556]: pgmap v445: 129 pgs: 129 active+clean; 977 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 1.38k op/s 2024-09-19T07:11:21.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:21 smithi046 ceph-mon[34147]: pgmap v445: 129 pgs: 129 active+clean; 977 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 1.38k op/s 2024-09-19T07:11:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 90.0 s, 1135.2 tps, lat 88.030 ms stddev 50.713 2024-09-19T07:11:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:23 smithi029 ceph-mon[31255]: pgmap v446: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:11:23.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:23 smithi078 ceph-mon[34556]: pgmap v446: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:11:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:23 smithi046 ceph-mon[34147]: pgmap v446: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-19T07:11:25.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:25 smithi029 ceph-mon[31255]: pgmap v447: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 1.41k op/s 2024-09-19T07:11:25.454 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:25 smithi078 ceph-mon[34556]: pgmap v447: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 1.41k op/s 2024-09-19T07:11:25.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:25 smithi046 ceph-mon[34147]: pgmap v447: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 1.41k op/s 2024-09-19T07:11:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 95.0 s, 1080.8 tps, lat 92.567 ms stddev 60.112 2024-09-19T07:11:27.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:27 smithi029 ceph-mon[31255]: pgmap v448: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.35k op/s 2024-09-19T07:11:27.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:27 smithi078 ceph-mon[34556]: pgmap v448: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.35k op/s 2024-09-19T07:11:27.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:27 smithi046 ceph-mon[34147]: pgmap v448: 129 pgs: 129 active+clean; 977 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.35k op/s 2024-09-19T07:11:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:29 smithi029 ceph-mon[31255]: pgmap v449: 129 pgs: 129 active+clean; 977 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 1.18k op/s 2024-09-19T07:11:29.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:29 smithi078 ceph-mon[34556]: pgmap v449: 129 pgs: 129 active+clean; 977 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 1.18k op/s 2024-09-19T07:11:29.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:29 smithi046 ceph-mon[34147]: pgmap v449: 129 pgs: 129 active+clean; 977 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 1.18k op/s 2024-09-19T07:11:31.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:31 smithi029 ceph-mon[31255]: pgmap v450: 129 pgs: 129 active+clean; 982 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 MiB/s wr, 1.42k op/s 2024-09-19T07:11:31.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:31 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:31.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:31 smithi078 ceph-mon[34556]: pgmap v450: 129 pgs: 129 active+clean; 982 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 MiB/s wr, 1.42k op/s 2024-09-19T07:11:31.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:31 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:31.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:31 smithi046 ceph-mon[34147]: pgmap v450: 129 pgs: 129 active+clean; 982 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 12 MiB/s wr, 1.42k op/s 2024-09-19T07:11:31.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:31 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:11:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 100.0 s, 986.8 tps, lat 101.273 ms stddev 139.026 2024-09-19T07:11:32.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:32.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:32.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:11:32.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:32.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:32.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:11:32.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:11:32.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:11:32.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:11:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:33 smithi078 ceph-mon[34556]: pgmap v451: 129 pgs: 129 active+clean; 986 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 10 MiB/s wr, 1.12k op/s 2024-09-19T07:11:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:33 smithi046 ceph-mon[34147]: pgmap v451: 129 pgs: 129 active+clean; 986 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 10 MiB/s wr, 1.12k op/s 2024-09-19T07:11:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:33 smithi029 ceph-mon[31255]: pgmap v451: 129 pgs: 129 active+clean; 986 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 10 MiB/s wr, 1.12k op/s 2024-09-19T07:11:35.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:35 smithi078 ceph-mon[34556]: pgmap v452: 129 pgs: 129 active+clean; 994 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2024-09-19T07:11:35.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:35 smithi046 ceph-mon[34147]: pgmap v452: 129 pgs: 129 active+clean; 994 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2024-09-19T07:11:36.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:35 smithi029 ceph-mon[31255]: pgmap v452: 129 pgs: 129 active+clean; 994 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 12 MiB/s wr, 1.26k op/s 2024-09-19T07:11:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 105.0 s, 1063.8 tps, lat 93.921 ms stddev 56.530 2024-09-19T07:11:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:37 smithi078 ceph-mon[34556]: pgmap v453: 129 pgs: 129 active+clean; 994 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:11:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:37 smithi046 ceph-mon[34147]: pgmap v453: 129 pgs: 129 active+clean; 994 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:11:38.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:37 smithi029 ceph-mon[31255]: pgmap v453: 129 pgs: 129 active+clean; 994 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:11:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:39 smithi078 ceph-mon[34556]: pgmap v454: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:11:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:39 smithi046 ceph-mon[34147]: pgmap v454: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:11:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:39 smithi029 ceph-mon[31255]: pgmap v454: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:11:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:41 smithi078 ceph-mon[34556]: pgmap v455: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.24k op/s 2024-09-19T07:11:41.976 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:41 smithi046 ceph-mon[34147]: pgmap v455: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.24k op/s 2024-09-19T07:11:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:41 smithi029 ceph-mon[31255]: pgmap v455: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 1.24k op/s 2024-09-19T07:11:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 110.0 s, 1064.8 tps, lat 93.772 ms stddev 62.549 2024-09-19T07:11:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:43 smithi078 ceph-mon[34556]: pgmap v456: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2024-09-19T07:11:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:43 smithi046 ceph-mon[34147]: pgmap v456: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2024-09-19T07:11:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:43 smithi029 ceph-mon[31255]: pgmap v456: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2024-09-19T07:11:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:45 smithi046 ceph-mon[34147]: pgmap v457: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-19T07:11:46.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:45 smithi029 ceph-mon[31255]: pgmap v457: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-19T07:11:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:45 smithi078 ceph-mon[34556]: pgmap v457: 129 pgs: 129 active+clean; 994 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-19T07:11:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 115.0 s, 1022.8 tps, lat 98.158 ms stddev 81.922 2024-09-19T07:11:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:47 smithi046 ceph-mon[34147]: pgmap v458: 129 pgs: 129 active+clean; 998 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.7 MiB/s wr, 1.12k op/s 2024-09-19T07:11:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:47 smithi029 ceph-mon[31255]: pgmap v458: 129 pgs: 129 active+clean; 998 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.7 MiB/s wr, 1.12k op/s 2024-09-19T07:11:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:47 smithi078 ceph-mon[34556]: pgmap v458: 129 pgs: 129 active+clean; 998 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.7 MiB/s wr, 1.12k op/s 2024-09-19T07:11:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:49 smithi046 ceph-mon[34147]: pgmap v459: 129 pgs: 129 active+clean; 998 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.5 MiB/s wr, 1.08k op/s 2024-09-19T07:11:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:49 smithi029 ceph-mon[31255]: pgmap v459: 129 pgs: 129 active+clean; 998 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.5 MiB/s wr, 1.08k op/s 2024-09-19T07:11:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:49 smithi078 ceph-mon[34556]: pgmap v459: 129 pgs: 129 active+clean; 998 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.5 MiB/s wr, 1.08k op/s 2024-09-19T07:11:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:51 smithi046 ceph-mon[34147]: pgmap v460: 129 pgs: 129 active+clean; 998 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-19T07:11:52.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:51 smithi029 ceph-mon[31255]: pgmap v460: 129 pgs: 129 active+clean; 998 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-19T07:11:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:51 smithi078 ceph-mon[34556]: pgmap v460: 129 pgs: 129 active+clean; 998 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-19T07:11:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 120.0 s, 1213.4 tps, lat 82.335 ms stddev 40.923 2024-09-19T07:11:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:53 smithi046 ceph-mon[34147]: pgmap v461: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9.8 MiB/s wr, 1.11k op/s 2024-09-19T07:11:53.997 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:53 smithi078 ceph-mon[34556]: pgmap v461: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9.8 MiB/s wr, 1.11k op/s 2024-09-19T07:11:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:53 smithi029 ceph-mon[31255]: pgmap v461: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9.8 MiB/s wr, 1.11k op/s 2024-09-19T07:11:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:55 smithi046 ceph-mon[34147]: pgmap v462: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 1.18k op/s 2024-09-19T07:11:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:55 smithi029 ceph-mon[31255]: pgmap v462: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 1.18k op/s 2024-09-19T07:11:56.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:55 smithi078 ceph-mon[34556]: pgmap v462: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 1.18k op/s 2024-09-19T07:11:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 125.0 s, 1085.0 tps, lat 92.153 ms stddev 52.786 2024-09-19T07:11:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:57 smithi046 ceph-mon[34147]: pgmap v463: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:11:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:57 smithi029 ceph-mon[31255]: pgmap v463: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:11:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:57 smithi078 ceph-mon[34556]: pgmap v463: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:11:59 smithi029 ceph-mon[31255]: pgmap v464: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 9.7 MiB/s wr, 1.14k op/s 2024-09-19T07:12:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:11:59 smithi078 ceph-mon[34556]: pgmap v464: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 9.7 MiB/s wr, 1.14k op/s 2024-09-19T07:12:00.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:11:59 smithi046 ceph-mon[34147]: pgmap v464: 129 pgs: 129 active+clean; 998 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 9.7 MiB/s wr, 1.14k op/s 2024-09-19T07:12:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:01 smithi029 ceph-mon[31255]: pgmap v465: 129 pgs: 129 active+clean; 998 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 MiB/s wr, 1.29k op/s 2024-09-19T07:12:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:01 smithi078 ceph-mon[34556]: pgmap v465: 129 pgs: 129 active+clean; 998 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 MiB/s wr, 1.29k op/s 2024-09-19T07:12:02.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:01 smithi046 ceph-mon[34147]: pgmap v465: 129 pgs: 129 active+clean; 998 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 MiB/s wr, 1.29k op/s 2024-09-19T07:12:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 130.0 s, 1058.4 tps, lat 94.279 ms stddev 37.645 2024-09-19T07:12:04.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:03 smithi029 ceph-mon[31255]: pgmap v466: 129 pgs: 129 active+clean; 998 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9.0 MiB/s wr, 1.08k op/s 2024-09-19T07:12:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:03 smithi078 ceph-mon[34556]: pgmap v466: 129 pgs: 129 active+clean; 998 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9.0 MiB/s wr, 1.08k op/s 2024-09-19T07:12:04.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:03 smithi046 ceph-mon[34147]: pgmap v466: 129 pgs: 129 active+clean; 998 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 9.0 MiB/s wr, 1.08k op/s 2024-09-19T07:12:06.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:05 smithi029 ceph-mon[31255]: pgmap v467: 129 pgs: 129 active+clean; 1002 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:05 smithi078 ceph-mon[34556]: pgmap v467: 129 pgs: 129 active+clean; 1002 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:06.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:05 smithi046 ceph-mon[34147]: pgmap v467: 129 pgs: 129 active+clean; 1002 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 135.0 s, 901.2 tps, lat 111.113 ms stddev 124.976 2024-09-19T07:12:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:07 smithi029 ceph-mon[31255]: pgmap v468: 129 pgs: 129 active+clean; 1006 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-19T07:12:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:07 smithi078 ceph-mon[34556]: pgmap v468: 129 pgs: 129 active+clean; 1006 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-19T07:12:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:07 smithi046 ceph-mon[34147]: pgmap v468: 129 pgs: 129 active+clean; 1006 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-19T07:12:10.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:09 smithi029 ceph-mon[31255]: pgmap v469: 129 pgs: 129 active+clean; 1006 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 1.01k op/s 2024-09-19T07:12:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:09 smithi078 ceph-mon[34556]: pgmap v469: 129 pgs: 129 active+clean; 1006 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 1.01k op/s 2024-09-19T07:12:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:09 smithi046 ceph-mon[34147]: pgmap v469: 129 pgs: 129 active+clean; 1006 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.2 MiB/s wr, 1.01k op/s 2024-09-19T07:12:12.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:11 smithi029 ceph-mon[31255]: pgmap v470: 129 pgs: 129 active+clean; 1014 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:12:12.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:11 smithi078 ceph-mon[34556]: pgmap v470: 129 pgs: 129 active+clean; 1014 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:12:12.232 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:11 smithi046 ceph-mon[34147]: pgmap v470: 129 pgs: 129 active+clean; 1014 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-19T07:12:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 140.0 s, 951.6 tps, lat 104.789 ms stddev 45.813 2024-09-19T07:12:14.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:13 smithi029 ceph-mon[31255]: pgmap v471: 129 pgs: 129 active+clean; 1014 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:12:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:13 smithi078 ceph-mon[34556]: pgmap v471: 129 pgs: 129 active+clean; 1014 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:12:14.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:13 smithi046 ceph-mon[34147]: pgmap v471: 129 pgs: 129 active+clean; 1014 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.5 MiB/s wr, 965 op/s 2024-09-19T07:12:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:15 smithi029 ceph-mon[31255]: pgmap v472: 129 pgs: 129 active+clean; 1015 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-19T07:12:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:15 smithi078 ceph-mon[34556]: pgmap v472: 129 pgs: 129 active+clean; 1015 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-19T07:12:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:15 smithi046 ceph-mon[34147]: pgmap v472: 129 pgs: 129 active+clean; 1015 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-09-19T07:12:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 145.0 s, 1165.0 tps, lat 86.290 ms stddev 35.633 2024-09-19T07:12:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:17 smithi029 ceph-mon[31255]: pgmap v473: 129 pgs: 129 active+clean; 1015 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:12:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:17 smithi078 ceph-mon[34556]: pgmap v473: 129 pgs: 129 active+clean; 1015 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:12:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:17 smithi046 ceph-mon[34147]: pgmap v473: 129 pgs: 129 active+clean; 1015 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 1.05k op/s 2024-09-19T07:12:20.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:19 smithi029 ceph-mon[31255]: pgmap v474: 129 pgs: 129 active+clean; 1015 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.1 MiB/s wr, 976 op/s 2024-09-19T07:12:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:19 smithi078 ceph-mon[34556]: pgmap v474: 129 pgs: 129 active+clean; 1015 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.1 MiB/s wr, 976 op/s 2024-09-19T07:12:20.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:19 smithi046 ceph-mon[34147]: pgmap v474: 129 pgs: 129 active+clean; 1015 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.1 MiB/s wr, 976 op/s 2024-09-19T07:12:22.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:21 smithi029 ceph-mon[31255]: pgmap v475: 129 pgs: 129 active+clean; 1015 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-19T07:12:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:21 smithi078 ceph-mon[34556]: pgmap v475: 129 pgs: 129 active+clean; 1015 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-19T07:12:22.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:21 smithi046 ceph-mon[34147]: pgmap v475: 129 pgs: 129 active+clean; 1015 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-19T07:12:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 150.0 s, 1192.6 tps, lat 83.767 ms stddev 24.271 2024-09-19T07:12:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:23 smithi029 ceph-mon[31255]: pgmap v476: 129 pgs: 129 active+clean; 1015 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 1.09k op/s 2024-09-19T07:12:24.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:23 smithi078 ceph-mon[34556]: pgmap v476: 129 pgs: 129 active+clean; 1015 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 1.09k op/s 2024-09-19T07:12:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:23 smithi046 ceph-mon[34147]: pgmap v476: 129 pgs: 129 active+clean; 1015 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.3 MiB/s wr, 1.09k op/s 2024-09-19T07:12:26.029 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:25 smithi046 ceph-mon[34147]: pgmap v477: 129 pgs: 129 active+clean; 1015 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:26.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:25 smithi029 ceph-mon[31255]: pgmap v477: 129 pgs: 129 active+clean; 1015 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:25 smithi078 ceph-mon[34556]: pgmap v477: 129 pgs: 129 active+clean; 1015 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 155.0 s, 1009.4 tps, lat 98.843 ms stddev 55.611 2024-09-19T07:12:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:27 smithi029 ceph-mon[31255]: pgmap v478: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 1.21k op/s 2024-09-19T07:12:28.197 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:27 smithi078 ceph-mon[34556]: pgmap v478: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 1.21k op/s 2024-09-19T07:12:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:27 smithi046 ceph-mon[34147]: pgmap v478: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 1.21k op/s 2024-09-19T07:12:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:29 smithi029 ceph-mon[31255]: pgmap v479: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 1.06k op/s 2024-09-19T07:12:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:29 smithi078 ceph-mon[34556]: pgmap v479: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 1.06k op/s 2024-09-19T07:12:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:29 smithi046 ceph-mon[34147]: pgmap v479: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 1.06k op/s 2024-09-19T07:12:32.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:31 smithi029 ceph-mon[31255]: pgmap v480: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:32.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:31 smithi078 ceph-mon[34556]: pgmap v480: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:32.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:31 smithi046 ceph-mon[34147]: pgmap v480: 129 pgs: 129 active+clean; 1015 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 MiB/s wr, 1.25k op/s 2024-09-19T07:12:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 160.0 s, 1002.0 tps, lat 99.332 ms stddev 45.491 2024-09-19T07:12:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:12:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:12:33.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:12:33.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:12:33.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:12:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:12:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:12:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:12:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:12:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:33 smithi029 ceph-mon[31255]: pgmap v481: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.2 MiB/s wr, 1.07k op/s 2024-09-19T07:12:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:33 smithi078 ceph-mon[34556]: pgmap v481: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.2 MiB/s wr, 1.07k op/s 2024-09-19T07:12:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:33 smithi046 ceph-mon[34147]: pgmap v481: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.2 MiB/s wr, 1.07k op/s 2024-09-19T07:12:36.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:35 smithi029 ceph-mon[31255]: pgmap v482: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.5 MiB/s wr, 1.12k op/s 2024-09-19T07:12:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:35 smithi078 ceph-mon[34556]: pgmap v482: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.5 MiB/s wr, 1.12k op/s 2024-09-19T07:12:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:35 smithi046 ceph-mon[34147]: pgmap v482: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.5 MiB/s wr, 1.12k op/s 2024-09-19T07:12:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 165.0 s, 958.8 tps, lat 104.650 ms stddev 59.850 2024-09-19T07:12:38.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:37 smithi029 ceph-mon[31255]: pgmap v483: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.7 MiB/s wr, 1.03k op/s 2024-09-19T07:12:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:37 smithi078 ceph-mon[34556]: pgmap v483: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.7 MiB/s wr, 1.03k op/s 2024-09-19T07:12:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:37 smithi046 ceph-mon[34147]: pgmap v483: 129 pgs: 129 active+clean; 1015 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 8.7 MiB/s wr, 1.03k op/s 2024-09-19T07:12:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:39 smithi029 ceph-mon[31255]: pgmap v484: 129 pgs: 129 active+clean; 1015 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.7 MiB/s wr, 905 op/s 2024-09-19T07:12:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:39 smithi078 ceph-mon[34556]: pgmap v484: 129 pgs: 129 active+clean; 1015 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.7 MiB/s wr, 905 op/s 2024-09-19T07:12:40.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:39 smithi046 ceph-mon[34147]: pgmap v484: 129 pgs: 129 active+clean; 1015 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.7 MiB/s wr, 905 op/s 2024-09-19T07:12:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:41 smithi029 ceph-mon[31255]: pgmap v485: 129 pgs: 129 active+clean; 1015 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.5 MiB/s wr, 1.11k op/s 2024-09-19T07:12:42.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:41 smithi078 ceph-mon[34556]: pgmap v485: 129 pgs: 129 active+clean; 1015 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.5 MiB/s wr, 1.11k op/s 2024-09-19T07:12:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:41 smithi046 ceph-mon[34147]: pgmap v485: 129 pgs: 129 active+clean; 1015 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.5 MiB/s wr, 1.11k op/s 2024-09-19T07:12:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 170.0 s, 900.6 tps, lat 111.490 ms stddev 117.439 2024-09-19T07:12:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:43 smithi029 ceph-mon[31255]: pgmap v486: 129 pgs: 129 active+clean; 1015 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 7.8 MiB/s wr, 924 op/s 2024-09-19T07:12:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:43 smithi078 ceph-mon[34556]: pgmap v486: 129 pgs: 129 active+clean; 1015 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 7.8 MiB/s wr, 924 op/s 2024-09-19T07:12:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:43 smithi046 ceph-mon[34147]: pgmap v486: 129 pgs: 129 active+clean; 1015 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 7.8 MiB/s wr, 924 op/s 2024-09-19T07:12:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:45 smithi029 ceph-mon[31255]: pgmap v487: 129 pgs: 129 active+clean; 1.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2024-09-19T07:12:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:45 smithi078 ceph-mon[34556]: pgmap v487: 129 pgs: 129 active+clean; 1.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2024-09-19T07:12:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:45 smithi046 ceph-mon[34147]: pgmap v487: 129 pgs: 129 active+clean; 1.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2024-09-19T07:12:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 175.0 s, 899.0 tps, lat 110.634 ms stddev 51.598 2024-09-19T07:12:48.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:47 smithi029 ceph-mon[31255]: pgmap v488: 129 pgs: 129 active+clean; 1.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.5 MiB/s wr, 971 op/s 2024-09-19T07:12:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:47 smithi078 ceph-mon[34556]: pgmap v488: 129 pgs: 129 active+clean; 1.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.5 MiB/s wr, 971 op/s 2024-09-19T07:12:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:47 smithi046 ceph-mon[34147]: pgmap v488: 129 pgs: 129 active+clean; 1.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.5 MiB/s wr, 971 op/s 2024-09-19T07:12:50.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:49 smithi029 ceph-mon[31255]: pgmap v489: 129 pgs: 129 active+clean; 1.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 889 op/s 2024-09-19T07:12:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:49 smithi078 ceph-mon[34556]: pgmap v489: 129 pgs: 129 active+clean; 1.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 889 op/s 2024-09-19T07:12:50.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:49 smithi046 ceph-mon[34147]: pgmap v489: 129 pgs: 129 active+clean; 1.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 8.9 MiB/s wr, 889 op/s 2024-09-19T07:12:52.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:51 smithi029 ceph-mon[31255]: pgmap v490: 129 pgs: 129 active+clean; 1.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.06k op/s 2024-09-19T07:12:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:51 smithi078 ceph-mon[34556]: pgmap v490: 129 pgs: 129 active+clean; 1.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.06k op/s 2024-09-19T07:12:52.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:51 smithi046 ceph-mon[34147]: pgmap v490: 129 pgs: 129 active+clean; 1.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 1.06k op/s 2024-09-19T07:12:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 180.0 s, 907.2 tps, lat 110.257 ms stddev 42.761 2024-09-19T07:12:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:53 smithi029 ceph-mon[31255]: pgmap v491: 129 pgs: 129 active+clean; 1.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 847 op/s 2024-09-19T07:12:54.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:53 smithi078 ceph-mon[34556]: pgmap v491: 129 pgs: 129 active+clean; 1.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 847 op/s 2024-09-19T07:12:54.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:53 smithi046 ceph-mon[34147]: pgmap v491: 129 pgs: 129 active+clean; 1.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.5 MiB/s wr, 847 op/s 2024-09-19T07:12:56.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:55 smithi029 ceph-mon[31255]: pgmap v492: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.2 MiB/s wr, 930 op/s 2024-09-19T07:12:56.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:55 smithi078 ceph-mon[34556]: pgmap v492: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.2 MiB/s wr, 930 op/s 2024-09-19T07:12:56.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:55 smithi046 ceph-mon[34147]: pgmap v492: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.2 MiB/s wr, 930 op/s 2024-09-19T07:12:57.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 185.0 s, 925.0 tps, lat 107.956 ms stddev 56.457 2024-09-19T07:12:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:57 smithi029 ceph-mon[31255]: pgmap v493: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 MiB/s wr, 920 op/s 2024-09-19T07:12:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:57 smithi078 ceph-mon[34556]: pgmap v493: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 MiB/s wr, 920 op/s 2024-09-19T07:12:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:57 smithi046 ceph-mon[34147]: pgmap v493: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.2 MiB/s wr, 920 op/s 2024-09-19T07:13:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:12:59 smithi029 ceph-mon[31255]: pgmap v494: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.3 MiB/s wr, 849 op/s 2024-09-19T07:13:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:12:59 smithi078 ceph-mon[34556]: pgmap v494: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.3 MiB/s wr, 849 op/s 2024-09-19T07:13:00.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:12:59 smithi046 ceph-mon[34147]: pgmap v494: 129 pgs: 129 active+clean; 1.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.3 MiB/s wr, 849 op/s 2024-09-19T07:13:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:01 smithi029 ceph-mon[31255]: pgmap v495: 129 pgs: 129 active+clean; 1.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.7 MiB/s wr, 998 op/s 2024-09-19T07:13:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:01 smithi078 ceph-mon[34556]: pgmap v495: 129 pgs: 129 active+clean; 1.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.7 MiB/s wr, 998 op/s 2024-09-19T07:13:02.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:01 smithi046 ceph-mon[34147]: pgmap v495: 129 pgs: 129 active+clean; 1.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8.7 MiB/s wr, 998 op/s 2024-09-19T07:13:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 190.0 s, 948.5 tps, lat 105.870 ms stddev 67.350 2024-09-19T07:13:04.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:03 smithi029 ceph-mon[31255]: pgmap v496: 129 pgs: 129 active+clean; 1.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7.3 MiB/s wr, 842 op/s 2024-09-19T07:13:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:03 smithi078 ceph-mon[34556]: pgmap v496: 129 pgs: 129 active+clean; 1.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7.3 MiB/s wr, 842 op/s 2024-09-19T07:13:04.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:03 smithi046 ceph-mon[34147]: pgmap v496: 129 pgs: 129 active+clean; 1.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7.3 MiB/s wr, 842 op/s 2024-09-19T07:13:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:05 smithi029 ceph-mon[31255]: pgmap v497: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.7 MiB/s wr, 985 op/s 2024-09-19T07:13:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:05 smithi078 ceph-mon[34556]: pgmap v497: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.7 MiB/s wr, 985 op/s 2024-09-19T07:13:06.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:05 smithi046 ceph-mon[34147]: pgmap v497: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.7 MiB/s wr, 985 op/s 2024-09-19T07:13:07.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 195.0 s, 918.2 tps, lat 108.475 ms stddev 62.405 2024-09-19T07:13:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:07 smithi029 ceph-mon[31255]: pgmap v498: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.5 MiB/s wr, 970 op/s 2024-09-19T07:13:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:07 smithi078 ceph-mon[34556]: pgmap v498: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.5 MiB/s wr, 970 op/s 2024-09-19T07:13:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:07 smithi046 ceph-mon[34147]: pgmap v498: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8.5 MiB/s wr, 970 op/s 2024-09-19T07:13:09.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:08 smithi029 ceph-mon[31255]: pgmap v499: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 873 op/s 2024-09-19T07:13:09.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:08 smithi078 ceph-mon[34556]: pgmap v499: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 873 op/s 2024-09-19T07:13:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:08 smithi046 ceph-mon[34147]: pgmap v499: 129 pgs: 129 active+clean; 1.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.7 MiB/s wr, 873 op/s 2024-09-19T07:13:11.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:11 smithi029 ceph-mon[31255]: pgmap v500: 129 pgs: 129 active+clean; 1.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.8 MiB/s wr, 1.00k op/s 2024-09-19T07:13:11.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:11 smithi078 ceph-mon[34556]: pgmap v500: 129 pgs: 129 active+clean; 1.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.8 MiB/s wr, 1.00k op/s 2024-09-19T07:13:11.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:11 smithi046 ceph-mon[34147]: pgmap v500: 129 pgs: 129 active+clean; 1.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.8 MiB/s wr, 1.00k op/s 2024-09-19T07:13:12.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 200.0 s, 878.0 tps, lat 114.018 ms stddev 63.590 2024-09-19T07:13:13.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:13 smithi029 ceph-mon[31255]: pgmap v501: 129 pgs: 129 active+clean; 1.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 854 op/s 2024-09-19T07:13:13.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:13 smithi078 ceph-mon[34556]: pgmap v501: 129 pgs: 129 active+clean; 1.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 854 op/s 2024-09-19T07:13:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:13 smithi046 ceph-mon[34147]: pgmap v501: 129 pgs: 129 active+clean; 1.0 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 854 op/s 2024-09-19T07:13:15.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:15 smithi029 ceph-mon[31255]: pgmap v502: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 965 op/s 2024-09-19T07:13:15.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:15 smithi078 ceph-mon[34556]: pgmap v502: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 965 op/s 2024-09-19T07:13:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:15 smithi046 ceph-mon[34147]: pgmap v502: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 965 op/s 2024-09-19T07:13:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 205.0 s, 907.2 tps, lat 110.047 ms stddev 34.918 2024-09-19T07:13:17.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:17 smithi029 ceph-mon[31255]: pgmap v503: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 900 op/s 2024-09-19T07:13:17.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:17 smithi078 ceph-mon[34556]: pgmap v503: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 900 op/s 2024-09-19T07:13:17.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:17 smithi046 ceph-mon[34147]: pgmap v503: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 900 op/s 2024-09-19T07:13:19.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:19 smithi029 ceph-mon[31255]: pgmap v504: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.6 MiB/s wr, 865 op/s 2024-09-19T07:13:19.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:19 smithi078 ceph-mon[34556]: pgmap v504: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.6 MiB/s wr, 865 op/s 2024-09-19T07:13:19.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:19 smithi046 ceph-mon[34147]: pgmap v504: 129 pgs: 129 active+clean; 1.0 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.6 MiB/s wr, 865 op/s 2024-09-19T07:13:21.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:21 smithi029 ceph-mon[31255]: pgmap v505: 129 pgs: 129 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 975 op/s 2024-09-19T07:13:21.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:21 smithi078 ceph-mon[34556]: pgmap v505: 129 pgs: 129 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 975 op/s 2024-09-19T07:13:21.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:21 smithi046 ceph-mon[34147]: pgmap v505: 129 pgs: 129 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 975 op/s 2024-09-19T07:13:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 210.0 s, 817.4 tps, lat 117.939 ms stddev 63.897 2024-09-19T07:13:23.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:23 smithi029 ceph-mon[31255]: pgmap v506: 129 pgs: 129 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.8 MiB/s wr, 798 op/s 2024-09-19T07:13:23.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:23 smithi078 ceph-mon[34556]: pgmap v506: 129 pgs: 129 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.8 MiB/s wr, 798 op/s 2024-09-19T07:13:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:23 smithi046 ceph-mon[34147]: pgmap v506: 129 pgs: 129 active+clean; 1.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.8 MiB/s wr, 798 op/s 2024-09-19T07:13:25.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:25 smithi029 ceph-mon[31255]: pgmap v507: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 920 op/s 2024-09-19T07:13:25.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:25 smithi078 ceph-mon[34556]: pgmap v507: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 920 op/s 2024-09-19T07:13:25.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:25 smithi046 ceph-mon[34147]: pgmap v507: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 920 op/s 2024-09-19T07:13:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 215.0 s, 864.6 tps, lat 120.168 ms stddev 112.130 2024-09-19T07:13:27.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:27 smithi029 ceph-mon[31255]: pgmap v508: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.4 MiB/s wr, 872 op/s 2024-09-19T07:13:27.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:27 smithi078 ceph-mon[34556]: pgmap v508: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.4 MiB/s wr, 872 op/s 2024-09-19T07:13:27.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:27 smithi046 ceph-mon[34147]: pgmap v508: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.4 MiB/s wr, 872 op/s 2024-09-19T07:13:29.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:29 smithi029 ceph-mon[31255]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.4 MiB/s wr, 827 op/s 2024-09-19T07:13:29.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:29 smithi078 ceph-mon[34556]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.4 MiB/s wr, 827 op/s 2024-09-19T07:13:29.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:29 smithi046 ceph-mon[34147]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.4 MiB/s wr, 827 op/s 2024-09-19T07:13:31.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:31 smithi029 ceph-mon[31255]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 890 op/s 2024-09-19T07:13:31.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:31 smithi078 ceph-mon[34556]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 890 op/s 2024-09-19T07:13:31.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:31 smithi046 ceph-mon[34147]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 890 op/s 2024-09-19T07:13:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 220.0 s, 872.4 tps, lat 113.987 ms stddev 44.417 2024-09-19T07:13:33.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:33 smithi029 ceph-mon[31255]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 778 op/s 2024-09-19T07:13:33.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:33 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:33.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:33 smithi078 ceph-mon[34556]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 778 op/s 2024-09-19T07:13:33.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:33 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:33.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:33 smithi046 ceph-mon[34147]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.9 MiB/s wr, 778 op/s 2024-09-19T07:13:33.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:33 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:34.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:34.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:34.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:13:34.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:34.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:34.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:13:34.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:34.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:34.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:13:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:35 smithi029 ceph-mon[31255]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 906 op/s 2024-09-19T07:13:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:35 smithi078 ceph-mon[34556]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 906 op/s 2024-09-19T07:13:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:35 smithi046 ceph-mon[34147]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.1 MiB/s wr, 906 op/s 2024-09-19T07:13:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 225.0 s, 998.8 tps, lat 100.677 ms stddev 41.215 2024-09-19T07:13:37.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:37 smithi029 ceph-mon[31255]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.9 MiB/s wr, 856 op/s 2024-09-19T07:13:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:37 smithi078 ceph-mon[34556]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.9 MiB/s wr, 856 op/s 2024-09-19T07:13:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:37 smithi046 ceph-mon[34147]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.9 MiB/s wr, 856 op/s 2024-09-19T07:13:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:39 smithi029 ceph-mon[31255]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 786 op/s 2024-09-19T07:13:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:39 smithi078 ceph-mon[34556]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 786 op/s 2024-09-19T07:13:40.005 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:39 smithi046 ceph-mon[34147]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 786 op/s 2024-09-19T07:13:41.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:41 smithi029 ceph-mon[31255]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.3 MiB/s wr, 975 op/s 2024-09-19T07:13:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:41 smithi078 ceph-mon[34556]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.3 MiB/s wr, 975 op/s 2024-09-19T07:13:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:41 smithi046 ceph-mon[34147]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.3 MiB/s wr, 975 op/s 2024-09-19T07:13:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 230.0 s, 1052.6 tps, lat 95.230 ms stddev 50.555 2024-09-19T07:13:43.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:43 smithi029 ceph-mon[31255]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.5 MiB/s wr, 883 op/s 2024-09-19T07:13:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:43 smithi078 ceph-mon[34556]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.5 MiB/s wr, 883 op/s 2024-09-19T07:13:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:43 smithi046 ceph-mon[34147]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.5 MiB/s wr, 883 op/s 2024-09-19T07:13:45.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:45 smithi029 ceph-mon[31255]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 MiB/s wr, 1.03k op/s 2024-09-19T07:13:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:45 smithi078 ceph-mon[34556]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 MiB/s wr, 1.03k op/s 2024-09-19T07:13:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:45 smithi046 ceph-mon[34147]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.8 MiB/s wr, 1.03k op/s 2024-09-19T07:13:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 235.0 s, 927.8 tps, lat 107.208 ms stddev 45.038 2024-09-19T07:13:47.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:47 smithi029 ceph-mon[31255]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.7 MiB/s wr, 1.02k op/s 2024-09-19T07:13:47.949 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:47 smithi078 ceph-mon[34556]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.7 MiB/s wr, 1.02k op/s 2024-09-19T07:13:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:47 smithi046 ceph-mon[34147]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.7 MiB/s wr, 1.02k op/s 2024-09-19T07:13:49.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:49 smithi029 ceph-mon[31255]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.0 MiB/s wr, 954 op/s 2024-09-19T07:13:49.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:49 smithi078 ceph-mon[34556]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.0 MiB/s wr, 954 op/s 2024-09-19T07:13:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:49 smithi046 ceph-mon[34147]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.0 MiB/s wr, 954 op/s 2024-09-19T07:13:51.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:51 smithi029 ceph-mon[31255]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.6 MiB/s wr, 1.13k op/s 2024-09-19T07:13:51.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:51 smithi078 ceph-mon[34556]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.6 MiB/s wr, 1.13k op/s 2024-09-19T07:13:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:51 smithi046 ceph-mon[34147]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 9.6 MiB/s wr, 1.13k op/s 2024-09-19T07:13:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 240.0 s, 910.7 tps, lat 110.000 ms stddev 56.204 2024-09-19T07:13:53.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:53 smithi029 ceph-mon[31255]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.7 MiB/s wr, 904 op/s 2024-09-19T07:13:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:53 smithi078 ceph-mon[34556]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.7 MiB/s wr, 904 op/s 2024-09-19T07:13:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:53 smithi046 ceph-mon[34147]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 7.7 MiB/s wr, 904 op/s 2024-09-19T07:13:55.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:55 smithi029 ceph-mon[31255]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 MiB/s wr, 972 op/s 2024-09-19T07:13:55.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:55 smithi078 ceph-mon[34556]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 MiB/s wr, 972 op/s 2024-09-19T07:13:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:55 smithi046 ceph-mon[34147]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 MiB/s wr, 972 op/s 2024-09-19T07:13:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 245.0 s, 928.7 tps, lat 107.716 ms stddev 66.684 2024-09-19T07:13:57.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:57 smithi029 ceph-mon[31255]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8.0 MiB/s wr, 949 op/s 2024-09-19T07:13:57.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:57 smithi078 ceph-mon[34556]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8.0 MiB/s wr, 949 op/s 2024-09-19T07:13:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:57 smithi046 ceph-mon[34147]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 8.0 MiB/s wr, 949 op/s 2024-09-19T07:13:59.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:13:59 smithi029 ceph-mon[31255]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 839 op/s 2024-09-19T07:13:59.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:13:59 smithi078 ceph-mon[34556]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 839 op/s 2024-09-19T07:13:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:13:59 smithi046 ceph-mon[34147]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 839 op/s 2024-09-19T07:14:01.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:01 smithi029 ceph-mon[31255]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9.1 MiB/s wr, 1.04k op/s 2024-09-19T07:14:01.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:01 smithi078 ceph-mon[34556]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9.1 MiB/s wr, 1.04k op/s 2024-09-19T07:14:01.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:01 smithi046 ceph-mon[34147]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 9.1 MiB/s wr, 1.04k op/s 2024-09-19T07:14:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 250.0 s, 1002.0 tps, lat 99.694 ms stddev 52.069 2024-09-19T07:14:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:03 smithi029 ceph-mon[31255]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7.6 MiB/s wr, 874 op/s 2024-09-19T07:14:03.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:03 smithi078 ceph-mon[34556]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7.6 MiB/s wr, 874 op/s 2024-09-19T07:14:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:03 smithi046 ceph-mon[34147]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 7.6 MiB/s wr, 874 op/s 2024-09-19T07:14:05.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:05 smithi029 ceph-mon[31255]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.4 MiB/s wr, 1.01k op/s 2024-09-19T07:14:05.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:05 smithi078 ceph-mon[34556]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.4 MiB/s wr, 1.01k op/s 2024-09-19T07:14:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:05 smithi046 ceph-mon[34147]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.4 MiB/s wr, 1.01k op/s 2024-09-19T07:14:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 255.0 s, 792.6 tps, lat 126.374 ms stddev 200.329 2024-09-19T07:14:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:07 smithi029 ceph-mon[31255]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-09-19T07:14:07.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:07 smithi078 ceph-mon[34556]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-09-19T07:14:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:07 smithi046 ceph-mon[34147]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 MiB/s wr, 1.02k op/s 2024-09-19T07:14:09.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:09 smithi029 ceph-mon[31255]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 901 op/s 2024-09-19T07:14:09.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:09 smithi078 ceph-mon[34556]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 901 op/s 2024-09-19T07:14:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:09 smithi046 ceph-mon[34147]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 901 op/s 2024-09-19T07:14:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:11 smithi029 ceph-mon[31255]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-19T07:14:11.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:11 smithi078 ceph-mon[34556]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-19T07:14:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:11 smithi046 ceph-mon[34147]: pgmap v530: 129 pgs: 129 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-19T07:14:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 260.0 s, 758.0 tps, lat 109.614 ms stddev 147.606 2024-09-19T07:14:13.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:13 smithi029 ceph-mon[31255]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 869 op/s 2024-09-19T07:14:13.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:13 smithi078 ceph-mon[34556]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 869 op/s 2024-09-19T07:14:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:13 smithi046 ceph-mon[34147]: pgmap v531: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 13 MiB/s wr, 869 op/s 2024-09-19T07:14:15.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:15 smithi029 ceph-mon[31255]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 17 MiB/s wr, 977 op/s 2024-09-19T07:14:15.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:15 smithi078 ceph-mon[34556]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 17 MiB/s wr, 977 op/s 2024-09-19T07:14:15.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:15 smithi046 ceph-mon[34147]: pgmap v532: 129 pgs: 129 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 17 MiB/s wr, 977 op/s 2024-09-19T07:14:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 265.0 s, 1074.3 tps, lat 109.096 ms stddev 201.085 2024-09-19T07:14:17.876 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:17 smithi029 ceph-mon[31255]: pgmap v533: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 19 MiB/s wr, 927 op/s 2024-09-19T07:14:17.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:17 smithi078 ceph-mon[34556]: pgmap v533: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 19 MiB/s wr, 927 op/s 2024-09-19T07:14:17.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:17 smithi046 ceph-mon[34147]: pgmap v533: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 19 MiB/s wr, 927 op/s 2024-09-19T07:14:19.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:19 smithi029 ceph-mon[31255]: pgmap v534: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 17 MiB/s wr, 810 op/s 2024-09-19T07:14:19.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:19 smithi078 ceph-mon[34556]: pgmap v534: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 17 MiB/s wr, 810 op/s 2024-09-19T07:14:19.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:19 smithi046 ceph-mon[34147]: pgmap v534: 129 pgs: 129 active+clean; 1.1 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 17 MiB/s wr, 810 op/s 2024-09-19T07:14:21.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:21 smithi029 ceph-mon[31255]: pgmap v535: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 22 MiB/s wr, 939 op/s 2024-09-19T07:14:21.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:21 smithi078 ceph-mon[34556]: pgmap v535: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 22 MiB/s wr, 939 op/s 2024-09-19T07:14:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:21 smithi046 ceph-mon[34147]: pgmap v535: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 22 MiB/s wr, 939 op/s 2024-09-19T07:14:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 270.0 s, 840.6 tps, lat 118.053 ms stddev 188.561 2024-09-19T07:14:23.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:23 smithi029 ceph-mon[31255]: pgmap v536: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 19 MiB/s wr, 793 op/s 2024-09-19T07:14:23.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:23 smithi078 ceph-mon[34556]: pgmap v536: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 19 MiB/s wr, 793 op/s 2024-09-19T07:14:23.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:23 smithi046 ceph-mon[34147]: pgmap v536: 129 pgs: 129 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 19 MiB/s wr, 793 op/s 2024-09-19T07:14:25.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:25 smithi029 ceph-mon[31255]: pgmap v537: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 21 MiB/s wr, 885 op/s 2024-09-19T07:14:25.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:25 smithi078 ceph-mon[34556]: pgmap v537: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 21 MiB/s wr, 885 op/s 2024-09-19T07:14:25.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:25 smithi046 ceph-mon[34147]: pgmap v537: 129 pgs: 129 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 21 MiB/s wr, 885 op/s 2024-09-19T07:14:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 275.0 s, 1013.6 tps, lat 94.894 ms stddev 133.111 2024-09-19T07:14:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:27 smithi029 ceph-mon[31255]: pgmap v538: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 21 MiB/s wr, 894 op/s 2024-09-19T07:14:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:27 smithi078 ceph-mon[34556]: pgmap v538: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 21 MiB/s wr, 894 op/s 2024-09-19T07:14:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:27 smithi046 ceph-mon[34147]: pgmap v538: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 21 MiB/s wr, 894 op/s 2024-09-19T07:14:29.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:29 smithi078 ceph-mon[34556]: pgmap v539: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 18 MiB/s wr, 814 op/s 2024-09-19T07:14:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:29 smithi046 ceph-mon[34147]: pgmap v539: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 18 MiB/s wr, 814 op/s 2024-09-19T07:14:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:29 smithi029 ceph-mon[31255]: pgmap v539: 129 pgs: 129 active+clean; 1.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 18 MiB/s wr, 814 op/s 2024-09-19T07:14:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:31 smithi078 ceph-mon[34556]: pgmap v540: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 20 MiB/s wr, 943 op/s 2024-09-19T07:14:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:31 smithi046 ceph-mon[34147]: pgmap v540: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 20 MiB/s wr, 943 op/s 2024-09-19T07:14:32.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:31 smithi029 ceph-mon[31255]: pgmap v540: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 20 MiB/s wr, 943 op/s 2024-09-19T07:14:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 280.0 s, 945.6 tps, lat 110.312 ms stddev 182.982 2024-09-19T07:14:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:33 smithi078 ceph-mon[34556]: pgmap v541: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 825 op/s 2024-09-19T07:14:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:33 smithi046 ceph-mon[34147]: pgmap v541: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 825 op/s 2024-09-19T07:14:34.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:33 smithi029 ceph-mon[31255]: pgmap v541: 129 pgs: 129 active+clean; 1.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 16 MiB/s wr, 825 op/s 2024-09-19T07:14:34.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:34 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:34.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:34 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:35.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:34 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:35 smithi078 ceph-mon[34556]: pgmap v542: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 932 op/s 2024-09-19T07:14:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:35 smithi046 ceph-mon[34147]: pgmap v542: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 932 op/s 2024-09-19T07:14:36.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:35 smithi029 ceph-mon[31255]: pgmap v542: 129 pgs: 129 active+clean; 1.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 19 MiB/s wr, 932 op/s 2024-09-19T07:14:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 285.0 s, 875.7 tps, lat 111.047 ms stddev 136.204 2024-09-19T07:14:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:37 smithi078 ceph-mon[34556]: pgmap v543: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 19 MiB/s wr, 917 op/s 2024-09-19T07:14:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:37 smithi046 ceph-mon[34147]: pgmap v543: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 19 MiB/s wr, 917 op/s 2024-09-19T07:14:38.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:37 smithi029 ceph-mon[31255]: pgmap v543: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 19 MiB/s wr, 917 op/s 2024-09-19T07:14:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:39 smithi078 ceph-mon[34556]: pgmap v544: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-19T07:14:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:39 smithi046 ceph-mon[34147]: pgmap v544: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-19T07:14:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:39 smithi029 ceph-mon[31255]: pgmap v544: 129 pgs: 129 active+clean; 1.2 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 14 MiB/s wr, 791 op/s 2024-09-19T07:14:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:41 smithi078 ceph-mon[34556]: pgmap v545: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 19 MiB/s wr, 944 op/s 2024-09-19T07:14:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:41 smithi046 ceph-mon[34147]: pgmap v545: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 19 MiB/s wr, 944 op/s 2024-09-19T07:14:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:41 smithi029 ceph-mon[31255]: pgmap v545: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 19 MiB/s wr, 944 op/s 2024-09-19T07:14:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 290.0 s, 920.5 tps, lat 111.749 ms stddev 178.559 2024-09-19T07:14:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:43 smithi078 ceph-mon[34556]: pgmap v546: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 17 MiB/s wr, 841 op/s 2024-09-19T07:14:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:43 smithi046 ceph-mon[34147]: pgmap v546: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 17 MiB/s wr, 841 op/s 2024-09-19T07:14:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:43 smithi029 ceph-mon[31255]: pgmap v546: 129 pgs: 129 active+clean; 1.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 17 MiB/s wr, 841 op/s 2024-09-19T07:14:44.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:44.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:44.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:44.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:14:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:45 smithi078 ceph-mon[34556]: pgmap v547: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 19 MiB/s wr, 925 op/s 2024-09-19T07:14:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:45 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-19T07:14:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:45 smithi078 ceph-mon[34556]: Unable to set osd_memory_target on smithi029 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T07:14:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:45 smithi046 ceph-mon[34147]: pgmap v547: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 19 MiB/s wr, 925 op/s 2024-09-19T07:14:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:45 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-19T07:14:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:45 smithi046 ceph-mon[34147]: Unable to set osd_memory_target on smithi029 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T07:14:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:45 smithi029 ceph-mon[31255]: pgmap v547: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 19 MiB/s wr, 925 op/s 2024-09-19T07:14:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:45 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-19T07:14:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:45 smithi029 ceph-mon[31255]: Unable to set osd_memory_target on smithi029 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T07:14:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 295.0 s, 920.8 tps, lat 108.212 ms stddev 128.234 2024-09-19T07:14:47.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:47 smithi078 ceph-mon[34556]: pgmap v548: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 891 op/s 2024-09-19T07:14:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:47 smithi046 ceph-mon[34147]: pgmap v548: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 891 op/s 2024-09-19T07:14:48.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:47 smithi029 ceph-mon[31255]: pgmap v548: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 16 MiB/s wr, 891 op/s 2024-09-19T07:14:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:49 smithi078 ceph-mon[34556]: pgmap v549: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 790 op/s 2024-09-19T07:14:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:49 smithi046 ceph-mon[34147]: pgmap v549: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 790 op/s 2024-09-19T07:14:50.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:49 smithi029 ceph-mon[31255]: pgmap v549: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 790 op/s 2024-09-19T07:14:51.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:51 smithi078 ceph-mon[34556]: pgmap v550: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 17 MiB/s wr, 972 op/s 2024-09-19T07:14:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:51 smithi046 ceph-mon[34147]: pgmap v550: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 17 MiB/s wr, 972 op/s 2024-09-19T07:14:52.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:51 smithi029 ceph-mon[31255]: pgmap v550: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 17 MiB/s wr, 972 op/s 2024-09-19T07:14:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 300.0 s, 948.4 tps, lat 104.996 ms stddev 130.002 2024-09-19T07:14:53.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:53 smithi078 ceph-mon[34556]: pgmap v551: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 13 MiB/s wr, 816 op/s 2024-09-19T07:14:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:53 smithi046 ceph-mon[34147]: pgmap v551: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 13 MiB/s wr, 816 op/s 2024-09-19T07:14:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:53 smithi029 ceph-mon[31255]: pgmap v551: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 13 MiB/s wr, 816 op/s 2024-09-19T07:14:55.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:55 smithi078 ceph-mon[34556]: pgmap v552: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 15 MiB/s wr, 928 op/s 2024-09-19T07:14:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:55 smithi046 ceph-mon[34147]: pgmap v552: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 15 MiB/s wr, 928 op/s 2024-09-19T07:14:56.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:55 smithi029 ceph-mon[31255]: pgmap v552: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 15 MiB/s wr, 928 op/s 2024-09-19T07:14:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 305.0 s, 886.4 tps, lat 113.245 ms stddev 138.615 2024-09-19T07:14:57.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:57 smithi078 ceph-mon[34556]: pgmap v553: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 909 op/s 2024-09-19T07:14:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:57 smithi046 ceph-mon[34147]: pgmap v553: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 909 op/s 2024-09-19T07:14:58.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:57 smithi029 ceph-mon[31255]: pgmap v553: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 909 op/s 2024-09-19T07:14:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:14:59 smithi046 ceph-mon[34147]: pgmap v554: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 830 op/s 2024-09-19T07:15:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:14:59 smithi029 ceph-mon[31255]: pgmap v554: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 830 op/s 2024-09-19T07:15:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:14:59 smithi078 ceph-mon[34556]: pgmap v554: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 830 op/s 2024-09-19T07:15:01.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:01 smithi046 ceph-mon[34147]: pgmap v555: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 17 MiB/s wr, 973 op/s 2024-09-19T07:15:02.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:01 smithi029 ceph-mon[31255]: pgmap v555: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 17 MiB/s wr, 973 op/s 2024-09-19T07:15:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:01 smithi078 ceph-mon[34556]: pgmap v555: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 17 MiB/s wr, 973 op/s 2024-09-19T07:15:02.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 310.0 s, 827.7 tps, lat 120.424 ms stddev 170.918 2024-09-19T07:15:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:03 smithi046 ceph-mon[34147]: pgmap v556: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 779 op/s 2024-09-19T07:15:04.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:03 smithi029 ceph-mon[31255]: pgmap v556: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 779 op/s 2024-09-19T07:15:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:03 smithi078 ceph-mon[34556]: pgmap v556: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 12 MiB/s wr, 779 op/s 2024-09-19T07:15:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:05 smithi046 ceph-mon[34147]: pgmap v557: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 14 MiB/s wr, 864 op/s 2024-09-19T07:15:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:05 smithi029 ceph-mon[31255]: pgmap v557: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 14 MiB/s wr, 864 op/s 2024-09-19T07:15:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:05 smithi078 ceph-mon[34556]: pgmap v557: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 14 MiB/s wr, 864 op/s 2024-09-19T07:15:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 315.0 s, 687.9 tps, lat 145.262 ms stddev 169.654 2024-09-19T07:15:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:07 smithi046 ceph-mon[34147]: pgmap v558: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 827 op/s 2024-09-19T07:15:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:07 smithi029 ceph-mon[31255]: pgmap v558: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 827 op/s 2024-09-19T07:15:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:07 smithi078 ceph-mon[34556]: pgmap v558: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 13 MiB/s wr, 827 op/s 2024-09-19T07:15:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:09 smithi046 ceph-mon[34147]: pgmap v559: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-19T07:15:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:09 smithi029 ceph-mon[31255]: pgmap v559: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-19T07:15:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:09 smithi078 ceph-mon[34556]: pgmap v559: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-19T07:15:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:11 smithi046 ceph-mon[34147]: pgmap v560: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 857 op/s 2024-09-19T07:15:12.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:11 smithi029 ceph-mon[31255]: pgmap v560: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 857 op/s 2024-09-19T07:15:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:11 smithi078 ceph-mon[34556]: pgmap v560: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 13 MiB/s wr, 857 op/s 2024-09-19T07:15:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 320.0 s, 969.2 tps, lat 103.449 ms stddev 175.825 2024-09-19T07:15:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:13 smithi046 ceph-mon[34147]: pgmap v561: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 739 op/s 2024-09-19T07:15:14.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:13 smithi029 ceph-mon[31255]: pgmap v561: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 739 op/s 2024-09-19T07:15:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:13 smithi078 ceph-mon[34556]: pgmap v561: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 739 op/s 2024-09-19T07:15:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:15 smithi029 ceph-mon[31255]: pgmap v562: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 827 op/s 2024-09-19T07:15:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:15 smithi078 ceph-mon[34556]: pgmap v562: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 827 op/s 2024-09-19T07:15:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:15 smithi046 ceph-mon[34147]: pgmap v562: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 827 op/s 2024-09-19T07:15:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 325.0 s, 704.6 tps, lat 135.387 ms stddev 136.102 2024-09-19T07:15:18.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:17 smithi029 ceph-mon[31255]: pgmap v563: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-19T07:15:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:17 smithi078 ceph-mon[34556]: pgmap v563: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-19T07:15:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:17 smithi046 ceph-mon[34147]: pgmap v563: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 12 MiB/s wr, 824 op/s 2024-09-19T07:15:20.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:19 smithi029 ceph-mon[31255]: pgmap v564: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 727 op/s 2024-09-19T07:15:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:19 smithi078 ceph-mon[34556]: pgmap v564: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 727 op/s 2024-09-19T07:15:20.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:19 smithi046 ceph-mon[34147]: pgmap v564: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 727 op/s 2024-09-19T07:15:22.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:21 smithi029 ceph-mon[31255]: pgmap v565: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 13 MiB/s wr, 844 op/s 2024-09-19T07:15:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:21 smithi078 ceph-mon[34556]: pgmap v565: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 13 MiB/s wr, 844 op/s 2024-09-19T07:15:22.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:21 smithi046 ceph-mon[34147]: pgmap v565: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 13 MiB/s wr, 844 op/s 2024-09-19T07:15:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 330.0 s, 936.4 tps, lat 111.880 ms stddev 132.282 2024-09-19T07:15:23.997 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:23 smithi078 ceph-mon[34556]: pgmap v566: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 730 op/s 2024-09-19T07:15:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:23 smithi029 ceph-mon[31255]: pgmap v566: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 730 op/s 2024-09-19T07:15:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:23 smithi046 ceph-mon[34147]: pgmap v566: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 11 MiB/s wr, 730 op/s 2024-09-19T07:15:26.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:25 smithi029 ceph-mon[31255]: pgmap v567: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-09-19T07:15:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:25 smithi078 ceph-mon[34556]: pgmap v567: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-09-19T07:15:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:25 smithi046 ceph-mon[34147]: pgmap v567: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-09-19T07:15:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 335.0 s, 668.0 tps, lat 147.309 ms stddev 192.169 2024-09-19T07:15:28.026 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:27 smithi046 ceph-mon[34147]: pgmap v568: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-09-19T07:15:28.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:27 smithi029 ceph-mon[31255]: pgmap v568: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-09-19T07:15:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:27 smithi078 ceph-mon[34556]: pgmap v568: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 851 op/s 2024-09-19T07:15:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:29 smithi029 ceph-mon[31255]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 746 op/s 2024-09-19T07:15:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:29 smithi078 ceph-mon[34556]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 746 op/s 2024-09-19T07:15:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:29 smithi046 ceph-mon[34147]: pgmap v569: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 10 MiB/s wr, 746 op/s 2024-09-19T07:15:32.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:31 smithi029 ceph-mon[31255]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 12 MiB/s wr, 848 op/s 2024-09-19T07:15:32.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:31 smithi078 ceph-mon[34556]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 12 MiB/s wr, 848 op/s 2024-09-19T07:15:32.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:31 smithi046 ceph-mon[34147]: pgmap v570: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 12 MiB/s wr, 848 op/s 2024-09-19T07:15:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 340.0 s, 869.7 tps, lat 115.644 ms stddev 80.921 2024-09-19T07:15:34.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:33 smithi029 ceph-mon[31255]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 8.8 MiB/s wr, 721 op/s 2024-09-19T07:15:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:33 smithi078 ceph-mon[34556]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 8.8 MiB/s wr, 721 op/s 2024-09-19T07:15:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:33 smithi046 ceph-mon[34147]: pgmap v571: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 8.8 MiB/s wr, 721 op/s 2024-09-19T07:15:36.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:35 smithi029 ceph-mon[31255]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-09-19T07:15:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:35 smithi078 ceph-mon[34556]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-09-19T07:15:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:35 smithi046 ceph-mon[34147]: pgmap v572: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-09-19T07:15:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 345.0 s, 932.8 tps, lat 108.152 ms stddev 68.250 2024-09-19T07:15:38.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:37 smithi029 ceph-mon[31255]: pgmap v573: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 10 MiB/s wr, 834 op/s 2024-09-19T07:15:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:37 smithi078 ceph-mon[34556]: pgmap v573: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 10 MiB/s wr, 834 op/s 2024-09-19T07:15:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:37 smithi046 ceph-mon[34147]: pgmap v573: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 10 MiB/s wr, 834 op/s 2024-09-19T07:15:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:39 smithi029 ceph-mon[31255]: pgmap v574: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 714 op/s 2024-09-19T07:15:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:39 smithi078 ceph-mon[34556]: pgmap v574: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 714 op/s 2024-09-19T07:15:40.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:39 smithi046 ceph-mon[34147]: pgmap v574: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.6 MiB/s wr, 714 op/s 2024-09-19T07:15:42.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:41 smithi029 ceph-mon[31255]: pgmap v575: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.6 MiB/s wr, 874 op/s 2024-09-19T07:15:42.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:41 smithi078 ceph-mon[34556]: pgmap v575: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.6 MiB/s wr, 874 op/s 2024-09-19T07:15:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:41 smithi046 ceph-mon[34147]: pgmap v575: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.6 MiB/s wr, 874 op/s 2024-09-19T07:15:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 350.0 s, 767.6 tps, lat 111.127 ms stddev 47.416 2024-09-19T07:15:44.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:43 smithi029 ceph-mon[31255]: pgmap v576: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.0 MiB/s wr, 787 op/s 2024-09-19T07:15:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:43 smithi078 ceph-mon[34556]: pgmap v576: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.0 MiB/s wr, 787 op/s 2024-09-19T07:15:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:43 smithi046 ceph-mon[34147]: pgmap v576: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.0 MiB/s wr, 787 op/s 2024-09-19T07:15:45.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:44 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:45.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:44 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:45.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:44 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: pgmap v577: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.9 MiB/s wr, 913 op/s 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:45 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: pgmap v577: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.9 MiB/s wr, 913 op/s 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:45 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: pgmap v577: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.9 MiB/s wr, 913 op/s 2024-09-19T07:15:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:46.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:45 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:46 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi078 to 176.0M 2024-09-19T07:15:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:46 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi046 to 177.0M 2024-09-19T07:15:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:46 smithi029 ceph-mon[31255]: Unable to set osd_memory_target on smithi078 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-19T07:15:47.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:46 smithi029 ceph-mon[31255]: Unable to set osd_memory_target on smithi046 to 185689907: error parsing value: Value '185689907' is below minimum 939524096 2024-09-19T07:15:47.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:46 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi078 to 176.0M 2024-09-19T07:15:47.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:46 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi046 to 177.0M 2024-09-19T07:15:47.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:46 smithi078 ceph-mon[34556]: Unable to set osd_memory_target on smithi078 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-19T07:15:47.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:46 smithi078 ceph-mon[34556]: Unable to set osd_memory_target on smithi046 to 185689907: error parsing value: Value '185689907' is below minimum 939524096 2024-09-19T07:15:47.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:46 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi078 to 176.0M 2024-09-19T07:15:47.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:46 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi046 to 177.0M 2024-09-19T07:15:47.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:46 smithi046 ceph-mon[34147]: Unable to set osd_memory_target on smithi078 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-19T07:15:47.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:46 smithi046 ceph-mon[34147]: Unable to set osd_memory_target on smithi046 to 185689907: error parsing value: Value '185689907' is below minimum 939524096 2024-09-19T07:15:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 355.0 s, 1033.8 tps, lat 111.094 ms stddev 124.711 2024-09-19T07:15:48.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:47 smithi029 ceph-mon[31255]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.5 MiB/s wr, 899 op/s 2024-09-19T07:15:48.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:48.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:48.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:47 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:15:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:47 smithi078 ceph-mon[34556]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.5 MiB/s wr, 899 op/s 2024-09-19T07:15:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:48.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:47 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:15:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:47 smithi046 ceph-mon[34147]: pgmap v578: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.5 MiB/s wr, 899 op/s 2024-09-19T07:15:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:48.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:47 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:15:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:49 smithi029 ceph-mon[31255]: pgmap v579: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.9 MiB/s wr, 777 op/s 2024-09-19T07:15:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:49 smithi078 ceph-mon[34556]: pgmap v579: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.9 MiB/s wr, 777 op/s 2024-09-19T07:15:50.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:49 smithi046 ceph-mon[34147]: pgmap v579: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.9 MiB/s wr, 777 op/s 2024-09-19T07:15:52.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:51 smithi029 ceph-mon[31255]: pgmap v580: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.8 MiB/s wr, 941 op/s 2024-09-19T07:15:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:51 smithi078 ceph-mon[34556]: pgmap v580: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.8 MiB/s wr, 941 op/s 2024-09-19T07:15:52.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:51 smithi046 ceph-mon[34147]: pgmap v580: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.8 MiB/s wr, 941 op/s 2024-09-19T07:15:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 360.0 s, 973.6 tps, lat 100.567 ms stddev 38.542 2024-09-19T07:15:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:53 smithi029 ceph-mon[31255]: pgmap v581: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 806 op/s 2024-09-19T07:15:54.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:53 smithi078 ceph-mon[34556]: pgmap v581: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 806 op/s 2024-09-19T07:15:54.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:53 smithi046 ceph-mon[34147]: pgmap v581: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 8.4 MiB/s wr, 806 op/s 2024-09-19T07:15:56.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:55 smithi029 ceph-mon[31255]: pgmap v582: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.6 MiB/s wr, 902 op/s 2024-09-19T07:15:56.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:55 smithi078 ceph-mon[34556]: pgmap v582: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.6 MiB/s wr, 902 op/s 2024-09-19T07:15:56.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:55 smithi046 ceph-mon[34147]: pgmap v582: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.6 MiB/s wr, 902 op/s 2024-09-19T07:15:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 365.0 s, 928.8 tps, lat 107.650 ms stddev 51.604 2024-09-19T07:15:58.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:57 smithi029 ceph-mon[31255]: pgmap v583: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.9 MiB/s wr, 892 op/s 2024-09-19T07:15:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:57 smithi078 ceph-mon[34556]: pgmap v583: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.9 MiB/s wr, 892 op/s 2024-09-19T07:15:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:57 smithi046 ceph-mon[34147]: pgmap v583: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.9 MiB/s wr, 892 op/s 2024-09-19T07:16:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:15:59 smithi029 ceph-mon[31255]: pgmap v584: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 800 op/s 2024-09-19T07:16:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:15:59 smithi078 ceph-mon[34556]: pgmap v584: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 800 op/s 2024-09-19T07:16:00.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:15:59 smithi046 ceph-mon[34147]: pgmap v584: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 800 op/s 2024-09-19T07:16:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:01 smithi029 ceph-mon[31255]: pgmap v585: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 959 op/s 2024-09-19T07:16:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:01 smithi078 ceph-mon[34556]: pgmap v585: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 959 op/s 2024-09-19T07:16:02.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:01 smithi046 ceph-mon[34147]: pgmap v585: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 959 op/s 2024-09-19T07:16:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 370.0 s, 924.2 tps, lat 109.612 ms stddev 93.156 2024-09-19T07:16:04.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:03 smithi029 ceph-mon[31255]: pgmap v586: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 805 op/s 2024-09-19T07:16:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:03 smithi078 ceph-mon[34556]: pgmap v586: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 805 op/s 2024-09-19T07:16:04.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:03 smithi046 ceph-mon[34147]: pgmap v586: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 805 op/s 2024-09-19T07:16:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:05 smithi029 ceph-mon[31255]: pgmap v587: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 927 op/s 2024-09-19T07:16:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:05 smithi078 ceph-mon[34556]: pgmap v587: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 927 op/s 2024-09-19T07:16:06.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:05 smithi046 ceph-mon[34147]: pgmap v587: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.4 MiB/s wr, 927 op/s 2024-09-19T07:16:07.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 375.0 s, 938.2 tps, lat 107.269 ms stddev 80.611 2024-09-19T07:16:08.128 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:07 smithi029 ceph-mon[31255]: pgmap v588: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 898 op/s 2024-09-19T07:16:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:07 smithi078 ceph-mon[34556]: pgmap v588: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 898 op/s 2024-09-19T07:16:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:07 smithi046 ceph-mon[34147]: pgmap v588: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.6 MiB/s wr, 898 op/s 2024-09-19T07:16:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:09 smithi029 ceph-mon[31255]: pgmap v589: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 815 op/s 2024-09-19T07:16:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:09 smithi078 ceph-mon[34556]: pgmap v589: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 815 op/s 2024-09-19T07:16:10.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:09 smithi046 ceph-mon[34147]: pgmap v589: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 815 op/s 2024-09-19T07:16:12.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:11 smithi029 ceph-mon[31255]: pgmap v590: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.6 MiB/s wr, 978 op/s 2024-09-19T07:16:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:11 smithi078 ceph-mon[34556]: pgmap v590: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.6 MiB/s wr, 978 op/s 2024-09-19T07:16:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:11 smithi046 ceph-mon[34147]: pgmap v590: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.6 MiB/s wr, 978 op/s 2024-09-19T07:16:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 380.0 s, 773.8 tps, lat 128.167 ms stddev 130.771 2024-09-19T07:16:14.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:13 smithi029 ceph-mon[31255]: pgmap v591: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 832 op/s 2024-09-19T07:16:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:13 smithi078 ceph-mon[34556]: pgmap v591: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 832 op/s 2024-09-19T07:16:14.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:13 smithi046 ceph-mon[34147]: pgmap v591: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 832 op/s 2024-09-19T07:16:16.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:15 smithi029 ceph-mon[31255]: pgmap v592: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.3 MiB/s wr, 948 op/s 2024-09-19T07:16:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:15 smithi078 ceph-mon[34556]: pgmap v592: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.3 MiB/s wr, 948 op/s 2024-09-19T07:16:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:15 smithi046 ceph-mon[34147]: pgmap v592: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.3 MiB/s wr, 948 op/s 2024-09-19T07:16:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 385.0 s, 616.4 tps, lat 163.597 ms stddev 159.547 2024-09-19T07:16:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:17 smithi078 ceph-mon[34556]: pgmap v593: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.2 MiB/s wr, 922 op/s 2024-09-19T07:16:18.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:17 smithi046 ceph-mon[34147]: pgmap v593: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.2 MiB/s wr, 922 op/s 2024-09-19T07:16:18.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:17 smithi029 ceph-mon[31255]: pgmap v593: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.2 MiB/s wr, 922 op/s 2024-09-19T07:16:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:19 smithi078 ceph-mon[34556]: pgmap v594: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 832 op/s 2024-09-19T07:16:20.226 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:19 smithi046 ceph-mon[34147]: pgmap v594: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 832 op/s 2024-09-19T07:16:20.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:19 smithi029 ceph-mon[31255]: pgmap v594: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.5 MiB/s wr, 832 op/s 2024-09-19T07:16:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:21 smithi078 ceph-mon[34556]: pgmap v595: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.5 MiB/s wr, 926 op/s 2024-09-19T07:16:22.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:21 smithi046 ceph-mon[34147]: pgmap v595: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.5 MiB/s wr, 926 op/s 2024-09-19T07:16:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 390.0 s, 595.4 tps, lat 147.800 ms stddev 165.743 2024-09-19T07:16:22.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:21 smithi029 ceph-mon[31255]: pgmap v595: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.5 MiB/s wr, 926 op/s 2024-09-19T07:16:24.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:23 smithi078 ceph-mon[34556]: pgmap v596: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.8 MiB/s wr, 753 op/s 2024-09-19T07:16:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:23 smithi046 ceph-mon[34147]: pgmap v596: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.8 MiB/s wr, 753 op/s 2024-09-19T07:16:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:23 smithi029 ceph-mon[31255]: pgmap v596: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.8 MiB/s wr, 753 op/s 2024-09-19T07:16:26.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:25 smithi029 ceph-mon[31255]: pgmap v597: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.5 MiB/s wr, 851 op/s 2024-09-19T07:16:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:25 smithi078 ceph-mon[34556]: pgmap v597: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.5 MiB/s wr, 851 op/s 2024-09-19T07:16:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:25 smithi046 ceph-mon[34147]: pgmap v597: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.5 MiB/s wr, 851 op/s 2024-09-19T07:16:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 395.0 s, 553.4 tps, lat 191.105 ms stddev 263.573 2024-09-19T07:16:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:27 smithi078 ceph-mon[34556]: pgmap v598: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 843 op/s 2024-09-19T07:16:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:27 smithi046 ceph-mon[34147]: pgmap v598: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 843 op/s 2024-09-19T07:16:28.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:27 smithi029 ceph-mon[31255]: pgmap v598: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 9.8 MiB/s wr, 843 op/s 2024-09-19T07:16:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:29 smithi078 ceph-mon[34556]: pgmap v599: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.2 MiB/s wr, 714 op/s 2024-09-19T07:16:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:29 smithi046 ceph-mon[34147]: pgmap v599: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.2 MiB/s wr, 714 op/s 2024-09-19T07:16:30.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:29 smithi029 ceph-mon[31255]: pgmap v599: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.2 MiB/s wr, 714 op/s 2024-09-19T07:16:32.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:31 smithi078 ceph-mon[34556]: pgmap v600: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 830 op/s 2024-09-19T07:16:32.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:31 smithi046 ceph-mon[34147]: pgmap v600: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 830 op/s 2024-09-19T07:16:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 400.0 s, 566.8 tps, lat 186.143 ms stddev 195.912 2024-09-19T07:16:32.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:31 smithi029 ceph-mon[31255]: pgmap v600: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 830 op/s 2024-09-19T07:16:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:33 smithi078 ceph-mon[34556]: pgmap v601: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 757 op/s 2024-09-19T07:16:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:33 smithi046 ceph-mon[34147]: pgmap v601: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 757 op/s 2024-09-19T07:16:34.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:33 smithi029 ceph-mon[31255]: pgmap v601: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.0 MiB/s wr, 757 op/s 2024-09-19T07:16:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:35 smithi078 ceph-mon[34556]: pgmap v602: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-19T07:16:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:35 smithi046 ceph-mon[34147]: pgmap v602: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-19T07:16:36.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:35 smithi029 ceph-mon[31255]: pgmap v602: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 858 op/s 2024-09-19T07:16:37.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:36 smithi078 ceph-mon[34556]: pgmap v603: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 856 op/s 2024-09-19T07:16:37.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:36 smithi046 ceph-mon[34147]: pgmap v603: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 856 op/s 2024-09-19T07:16:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 405.0 s, 522.0 tps, lat 192.203 ms stddev 229.025 2024-09-19T07:16:37.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:36 smithi029 ceph-mon[31255]: pgmap v603: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 10 MiB/s wr, 856 op/s 2024-09-19T07:16:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:39 smithi029 ceph-mon[31255]: pgmap v604: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 705 op/s 2024-09-19T07:16:39.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:39 smithi078 ceph-mon[34556]: pgmap v604: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 705 op/s 2024-09-19T07:16:39.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:39 smithi046 ceph-mon[34147]: pgmap v604: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 705 op/s 2024-09-19T07:16:41.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:41 smithi029 ceph-mon[31255]: pgmap v605: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 918 op/s 2024-09-19T07:16:41.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:41 smithi078 ceph-mon[34556]: pgmap v605: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 918 op/s 2024-09-19T07:16:41.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:41 smithi046 ceph-mon[34147]: pgmap v605: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 918 op/s 2024-09-19T07:16:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 410.0 s, 744.9 tps, lat 134.613 ms stddev 278.424 2024-09-19T07:16:43.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:43 smithi029 ceph-mon[31255]: pgmap v606: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-09-19T07:16:43.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:43 smithi078 ceph-mon[34556]: pgmap v606: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-09-19T07:16:43.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:43 smithi046 ceph-mon[34147]: pgmap v606: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-09-19T07:16:45.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:45 smithi078 ceph-mon[34556]: pgmap v607: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 966 op/s 2024-09-19T07:16:45.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:45 smithi046 ceph-mon[34147]: pgmap v607: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 966 op/s 2024-09-19T07:16:45.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:45 smithi029 ceph-mon[31255]: pgmap v607: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 966 op/s 2024-09-19T07:16:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 415.0 s, 940.7 tps, lat 106.107 ms stddev 37.484 2024-09-19T07:16:47.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:47 smithi078 ceph-mon[34556]: pgmap v608: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 953 op/s 2024-09-19T07:16:47.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:47 smithi046 ceph-mon[34147]: pgmap v608: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 953 op/s 2024-09-19T07:16:47.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:47 smithi029 ceph-mon[31255]: pgmap v608: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 953 op/s 2024-09-19T07:16:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:48 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:48.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:48 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:48.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:48 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:49.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:49 smithi078 ceph-mon[34556]: pgmap v609: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 791 op/s 2024-09-19T07:16:49.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:49.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:49.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:16:49.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:49 smithi046 ceph-mon[34147]: pgmap v609: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 791 op/s 2024-09-19T07:16:49.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:49.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:49.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:16:49.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:49 smithi029 ceph-mon[31255]: pgmap v609: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.4 MiB/s wr, 791 op/s 2024-09-19T07:16:49.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:49.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:49.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:16:51.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:51 smithi078 ceph-mon[34556]: pgmap v610: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-09-19T07:16:51.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:51 smithi046 ceph-mon[34147]: pgmap v610: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-09-19T07:16:51.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:51 smithi029 ceph-mon[31255]: pgmap v610: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-09-19T07:16:52.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 420.0 s, 634.7 tps, lat 157.637 ms stddev 235.899 2024-09-19T07:16:53.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:53 smithi078 ceph-mon[34556]: pgmap v611: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.7 MiB/s wr, 868 op/s 2024-09-19T07:16:53.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:53 smithi046 ceph-mon[34147]: pgmap v611: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.7 MiB/s wr, 868 op/s 2024-09-19T07:16:53.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:53 smithi029 ceph-mon[31255]: pgmap v611: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.7 MiB/s wr, 868 op/s 2024-09-19T07:16:55.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:55 smithi078 ceph-mon[34556]: pgmap v612: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 930 op/s 2024-09-19T07:16:55.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:55 smithi046 ceph-mon[34147]: pgmap v612: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 930 op/s 2024-09-19T07:16:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:55 smithi029 ceph-mon[31255]: pgmap v612: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 10 MiB/s wr, 930 op/s 2024-09-19T07:16:57.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 425.0 s, 692.4 tps, lat 142.333 ms stddev 154.428 2024-09-19T07:16:57.426 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:57 smithi029 ceph-mon[31255]: pgmap v613: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.2 MiB/s wr, 862 op/s 2024-09-19T07:16:57.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:57 smithi078 ceph-mon[34556]: pgmap v613: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.2 MiB/s wr, 862 op/s 2024-09-19T07:16:57.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:57 smithi046 ceph-mon[34147]: pgmap v613: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.2 MiB/s wr, 862 op/s 2024-09-19T07:16:59.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:16:59 smithi078 ceph-mon[34556]: pgmap v614: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-09-19T07:16:59.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:16:59 smithi046 ceph-mon[34147]: pgmap v614: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-09-19T07:16:59.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:16:59 smithi029 ceph-mon[31255]: pgmap v614: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.7 MiB/s wr, 724 op/s 2024-09-19T07:17:01.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:01 smithi078 ceph-mon[34556]: pgmap v615: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 948 op/s 2024-09-19T07:17:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:01 smithi046 ceph-mon[34147]: pgmap v615: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 948 op/s 2024-09-19T07:17:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:01 smithi029 ceph-mon[31255]: pgmap v615: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 948 op/s 2024-09-19T07:17:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 430.0 s, 702.0 tps, lat 144.550 ms stddev 176.882 2024-09-19T07:17:03.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:03 smithi078 ceph-mon[34556]: pgmap v616: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.5 MiB/s wr, 858 op/s 2024-09-19T07:17:03.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:03 smithi046 ceph-mon[34147]: pgmap v616: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.5 MiB/s wr, 858 op/s 2024-09-19T07:17:03.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:03 smithi029 ceph-mon[31255]: pgmap v616: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.5 MiB/s wr, 858 op/s 2024-09-19T07:17:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:05 smithi078 ceph-mon[34556]: pgmap v617: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 908 op/s 2024-09-19T07:17:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:05 smithi046 ceph-mon[34147]: pgmap v617: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 908 op/s 2024-09-19T07:17:05.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:05 smithi029 ceph-mon[31255]: pgmap v617: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 908 op/s 2024-09-19T07:17:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 435.0 s, 736.0 tps, lat 92.645 ms stddev 45.115 2024-09-19T07:17:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:07 smithi078 ceph-mon[34556]: pgmap v618: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.7 MiB/s wr, 907 op/s 2024-09-19T07:17:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:07 smithi046 ceph-mon[34147]: pgmap v618: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.7 MiB/s wr, 907 op/s 2024-09-19T07:17:07.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:07 smithi029 ceph-mon[31255]: pgmap v618: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.7 MiB/s wr, 907 op/s 2024-09-19T07:17:09.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:09 smithi078 ceph-mon[34556]: pgmap v619: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 801 op/s 2024-09-19T07:17:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:09 smithi046 ceph-mon[34147]: pgmap v619: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 801 op/s 2024-09-19T07:17:09.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:09 smithi029 ceph-mon[31255]: pgmap v619: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.7 MiB/s wr, 801 op/s 2024-09-19T07:17:11.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:11 smithi046 ceph-mon[34147]: pgmap v620: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-09-19T07:17:11.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:11 smithi029 ceph-mon[31255]: pgmap v620: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-09-19T07:17:11.697 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:11 smithi078 ceph-mon[34556]: pgmap v620: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 994 op/s 2024-09-19T07:17:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 440.0 s, 608.2 tps, lat 109.332 ms stddev 62.218 2024-09-19T07:17:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:13 smithi046 ceph-mon[34147]: pgmap v621: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.4 MiB/s wr, 896 op/s 2024-09-19T07:17:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:13 smithi029 ceph-mon[31255]: pgmap v621: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.4 MiB/s wr, 896 op/s 2024-09-19T07:17:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:13 smithi078 ceph-mon[34556]: pgmap v621: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.4 MiB/s wr, 896 op/s 2024-09-19T07:17:15.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:15 smithi046 ceph-mon[34147]: pgmap v622: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 906 op/s 2024-09-19T07:17:15.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:15 smithi029 ceph-mon[31255]: pgmap v622: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 906 op/s 2024-09-19T07:17:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:15 smithi078 ceph-mon[34556]: pgmap v622: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 10 MiB/s wr, 906 op/s 2024-09-19T07:17:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 445.0 s, 774.6 tps, lat 213.319 ms stddev 991.652 2024-09-19T07:17:17.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:17 smithi046 ceph-mon[34147]: pgmap v623: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.6 MiB/s wr, 896 op/s 2024-09-19T07:17:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:17 smithi029 ceph-mon[31255]: pgmap v623: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.6 MiB/s wr, 896 op/s 2024-09-19T07:17:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:17 smithi078 ceph-mon[34556]: pgmap v623: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.6 MiB/s wr, 896 op/s 2024-09-19T07:17:19.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:19 smithi046 ceph-mon[34147]: pgmap v624: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-09-19T07:17:19.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:19 smithi029 ceph-mon[31255]: pgmap v624: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-09-19T07:17:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:19 smithi078 ceph-mon[34556]: pgmap v624: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.8 MiB/s wr, 734 op/s 2024-09-19T07:17:21.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:21 smithi046 ceph-mon[34147]: pgmap v625: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.1 MiB/s wr, 868 op/s 2024-09-19T07:17:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:21 smithi029 ceph-mon[31255]: pgmap v625: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.1 MiB/s wr, 868 op/s 2024-09-19T07:17:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:21 smithi078 ceph-mon[34556]: pgmap v625: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.1 MiB/s wr, 868 op/s 2024-09-19T07:17:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 450.0 s, 704.0 tps, lat 135.846 ms stddev 73.737 2024-09-19T07:17:23.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:23 smithi046 ceph-mon[34147]: pgmap v626: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 813 op/s 2024-09-19T07:17:23.497 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:23 smithi078 ceph-mon[34556]: pgmap v626: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 813 op/s 2024-09-19T07:17:23.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:23 smithi029 ceph-mon[31255]: pgmap v626: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 813 op/s 2024-09-19T07:17:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:25 smithi029 ceph-mon[31255]: pgmap v627: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 855 op/s 2024-09-19T07:17:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:25 smithi078 ceph-mon[34556]: pgmap v627: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 855 op/s 2024-09-19T07:17:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:25 smithi046 ceph-mon[34147]: pgmap v627: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 855 op/s 2024-09-19T07:17:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 455.0 s, 560.8 tps, lat 182.806 ms stddev 199.250 2024-09-19T07:17:27.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:27 smithi029 ceph-mon[31255]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 MiB/s wr, 869 op/s 2024-09-19T07:17:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:27 smithi078 ceph-mon[34556]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 MiB/s wr, 869 op/s 2024-09-19T07:17:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:27 smithi046 ceph-mon[34147]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 MiB/s wr, 869 op/s 2024-09-19T07:17:29.526 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:29 smithi046 ceph-mon[34147]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 730 op/s 2024-09-19T07:17:29.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:29 smithi029 ceph-mon[31255]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 730 op/s 2024-09-19T07:17:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:29 smithi078 ceph-mon[34556]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.2 MiB/s wr, 730 op/s 2024-09-19T07:17:31.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:31 smithi029 ceph-mon[31255]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.8 MiB/s wr, 880 op/s 2024-09-19T07:17:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:31 smithi078 ceph-mon[34556]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.8 MiB/s wr, 880 op/s 2024-09-19T07:17:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:31 smithi046 ceph-mon[34147]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.8 MiB/s wr, 880 op/s 2024-09-19T07:17:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 460.0 s, 542.4 tps, lat 186.491 ms stddev 228.521 2024-09-19T07:17:33.625 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:33 smithi029 ceph-mon[31255]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.2 MiB/s wr, 888 op/s 2024-09-19T07:17:33.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:33 smithi078 ceph-mon[34556]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.2 MiB/s wr, 888 op/s 2024-09-19T07:17:33.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:33 smithi046 ceph-mon[34147]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.2 MiB/s wr, 888 op/s 2024-09-19T07:17:35.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:35 smithi029 ceph-mon[31255]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.3 MiB/s wr, 878 op/s 2024-09-19T07:17:35.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:35 smithi078 ceph-mon[34556]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.3 MiB/s wr, 878 op/s 2024-09-19T07:17:35.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:35 smithi046 ceph-mon[34147]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.3 MiB/s wr, 878 op/s 2024-09-19T07:17:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 465.0 s, 750.2 tps, lat 134.024 ms stddev 81.719 2024-09-19T07:17:37.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:37 smithi029 ceph-mon[31255]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.3 MiB/s wr, 810 op/s 2024-09-19T07:17:37.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:37 smithi078 ceph-mon[34556]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.3 MiB/s wr, 810 op/s 2024-09-19T07:17:37.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:37 smithi046 ceph-mon[34147]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.3 MiB/s wr, 810 op/s 2024-09-19T07:17:39.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:39 smithi029 ceph-mon[31255]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 701 op/s 2024-09-19T07:17:39.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:39 smithi078 ceph-mon[34556]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 701 op/s 2024-09-19T07:17:39.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:39 smithi046 ceph-mon[34147]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 701 op/s 2024-09-19T07:17:41.626 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:41 smithi029 ceph-mon[31255]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 838 op/s 2024-09-19T07:17:41.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:41 smithi078 ceph-mon[34556]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 838 op/s 2024-09-19T07:17:41.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:41 smithi046 ceph-mon[34147]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.4 MiB/s wr, 838 op/s 2024-09-19T07:17:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 470.0 s, 718.8 tps, lat 138.083 ms stddev 91.033 2024-09-19T07:17:43.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:43 smithi029 ceph-mon[31255]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 808 op/s 2024-09-19T07:17:43.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:43 smithi078 ceph-mon[34556]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 808 op/s 2024-09-19T07:17:43.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:43 smithi046 ceph-mon[34147]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.8 MiB/s wr, 808 op/s 2024-09-19T07:17:45.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:45 smithi029 ceph-mon[31255]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 790 op/s 2024-09-19T07:17:45.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:45 smithi078 ceph-mon[34556]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 790 op/s 2024-09-19T07:17:45.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:45 smithi046 ceph-mon[34147]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 790 op/s 2024-09-19T07:17:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 475.0 s, 646.0 tps, lat 153.691 ms stddev 113.337 2024-09-19T07:17:47.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:47 smithi029 ceph-mon[31255]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 779 op/s 2024-09-19T07:17:47.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:47 smithi078 ceph-mon[34556]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 779 op/s 2024-09-19T07:17:47.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:47 smithi046 ceph-mon[34147]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 779 op/s 2024-09-19T07:17:49.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:49 smithi029 ceph-mon[31255]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 696 op/s 2024-09-19T07:17:49.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:49 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:49.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:49 smithi078 ceph-mon[34556]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 696 op/s 2024-09-19T07:17:49.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:49 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:49.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:49 smithi046 ceph-mon[34147]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.2 MiB/s wr, 696 op/s 2024-09-19T07:17:49.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:49 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:50.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:50 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:50.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:50 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:50.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:50 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:17:50.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:50 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:50.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:50 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:50.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:50 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:17:50.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:50 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:50.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:50 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:50.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:50 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:17:51.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:51 smithi029 ceph-mon[31255]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 817 op/s 2024-09-19T07:17:51.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:51 smithi078 ceph-mon[34556]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 817 op/s 2024-09-19T07:17:51.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:51 smithi046 ceph-mon[34147]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 817 op/s 2024-09-19T07:17:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 480.0 s, 822.2 tps, lat 123.436 ms stddev 76.761 2024-09-19T07:17:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:53 smithi029 ceph-mon[31255]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 783 op/s 2024-09-19T07:17:53.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:53 smithi078 ceph-mon[34556]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 783 op/s 2024-09-19T07:17:53.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:53 smithi046 ceph-mon[34147]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.9 MiB/s wr, 783 op/s 2024-09-19T07:17:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:55 smithi029 ceph-mon[31255]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 808 op/s 2024-09-19T07:17:55.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:55 smithi078 ceph-mon[34556]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 808 op/s 2024-09-19T07:17:55.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:55 smithi046 ceph-mon[34147]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 MiB/s wr, 808 op/s 2024-09-19T07:17:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 485.0 s, 759.8 tps, lat 131.203 ms stddev 82.175 2024-09-19T07:17:57.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:57 smithi029 ceph-mon[31255]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.9 MiB/s wr, 783 op/s 2024-09-19T07:17:57.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:57 smithi078 ceph-mon[34556]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.9 MiB/s wr, 783 op/s 2024-09-19T07:17:57.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:57 smithi046 ceph-mon[34147]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.9 MiB/s wr, 783 op/s 2024-09-19T07:17:59.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:17:59 smithi029 ceph-mon[31255]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 676 op/s 2024-09-19T07:17:59.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:17:59 smithi078 ceph-mon[34556]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 676 op/s 2024-09-19T07:17:59.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:17:59 smithi046 ceph-mon[34147]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 676 op/s 2024-09-19T07:18:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:01 smithi029 ceph-mon[31255]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-09-19T07:18:01.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:01 smithi078 ceph-mon[34556]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-09-19T07:18:01.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:01 smithi046 ceph-mon[34147]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-09-19T07:18:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 490.0 s, 813.6 tps, lat 123.159 ms stddev 57.652 2024-09-19T07:18:03.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:03 smithi029 ceph-mon[31255]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 767 op/s 2024-09-19T07:18:03.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:03 smithi078 ceph-mon[34556]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 767 op/s 2024-09-19T07:18:03.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:03 smithi046 ceph-mon[34147]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 767 op/s 2024-09-19T07:18:05.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:05 smithi029 ceph-mon[31255]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.3 MiB/s wr, 797 op/s 2024-09-19T07:18:05.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:05 smithi078 ceph-mon[34556]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.3 MiB/s wr, 797 op/s 2024-09-19T07:18:05.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:05 smithi046 ceph-mon[34147]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.3 MiB/s wr, 797 op/s 2024-09-19T07:18:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 495.0 s, 663.4 tps, lat 149.181 ms stddev 69.582 2024-09-19T07:18:07.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:07 smithi029 ceph-mon[31255]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.1 MiB/s wr, 778 op/s 2024-09-19T07:18:07.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:07 smithi078 ceph-mon[34556]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.1 MiB/s wr, 778 op/s 2024-09-19T07:18:07.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:07 smithi046 ceph-mon[34147]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.1 MiB/s wr, 778 op/s 2024-09-19T07:18:09.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:09 smithi029 ceph-mon[31255]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-09-19T07:18:09.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:09 smithi078 ceph-mon[34556]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-09-19T07:18:09.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:09 smithi046 ceph-mon[34147]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-09-19T07:18:11.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:11 smithi029 ceph-mon[31255]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 786 op/s 2024-09-19T07:18:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:11 smithi078 ceph-mon[34556]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 786 op/s 2024-09-19T07:18:11.724 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:11 smithi046 ceph-mon[34147]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 786 op/s 2024-09-19T07:18:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 500.0 s, 684.2 tps, lat 143.331 ms stddev 66.442 2024-09-19T07:18:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:13 smithi029 ceph-mon[31255]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 746 op/s 2024-09-19T07:18:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:13 smithi078 ceph-mon[34556]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 746 op/s 2024-09-19T07:18:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:13 smithi046 ceph-mon[34147]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 746 op/s 2024-09-19T07:18:15.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:15 smithi029 ceph-mon[31255]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.5 MiB/s wr, 743 op/s 2024-09-19T07:18:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:15 smithi078 ceph-mon[34556]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.5 MiB/s wr, 743 op/s 2024-09-19T07:18:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:15 smithi046 ceph-mon[34147]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.5 MiB/s wr, 743 op/s 2024-09-19T07:18:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 505.0 s, 700.4 tps, lat 146.887 ms stddev 114.061 2024-09-19T07:18:17.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:17 smithi029 ceph-mon[31255]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 719 op/s 2024-09-19T07:18:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:17 smithi078 ceph-mon[34556]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 719 op/s 2024-09-19T07:18:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:17 smithi046 ceph-mon[34147]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 719 op/s 2024-09-19T07:18:19.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:19 smithi029 ceph-mon[31255]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.0 MiB/s wr, 592 op/s 2024-09-19T07:18:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:19 smithi078 ceph-mon[34556]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.0 MiB/s wr, 592 op/s 2024-09-19T07:18:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:19 smithi046 ceph-mon[34147]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.0 MiB/s wr, 592 op/s 2024-09-19T07:18:21.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:21 smithi029 ceph-mon[31255]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 758 op/s 2024-09-19T07:18:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:21 smithi078 ceph-mon[34556]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 758 op/s 2024-09-19T07:18:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:21 smithi046 ceph-mon[34147]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 758 op/s 2024-09-19T07:18:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 510.0 s, 748.4 tps, lat 134.048 ms stddev 101.174 2024-09-19T07:18:23.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:23 smithi029 ceph-mon[31255]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.2 MiB/s wr, 717 op/s 2024-09-19T07:18:23.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:23 smithi078 ceph-mon[34556]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.2 MiB/s wr, 717 op/s 2024-09-19T07:18:23.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:23 smithi046 ceph-mon[34147]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.2 MiB/s wr, 717 op/s 2024-09-19T07:18:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:25 smithi029 ceph-mon[31255]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 696 op/s 2024-09-19T07:18:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:25 smithi078 ceph-mon[34556]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 696 op/s 2024-09-19T07:18:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:25 smithi046 ceph-mon[34147]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 696 op/s 2024-09-19T07:18:27.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 515.0 s, 761.4 tps, lat 131.188 ms stddev 54.567 2024-09-19T07:18:27.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:27 smithi029 ceph-mon[31255]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 726 op/s 2024-09-19T07:18:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:27 smithi078 ceph-mon[34556]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 726 op/s 2024-09-19T07:18:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:27 smithi046 ceph-mon[34147]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 726 op/s 2024-09-19T07:18:29.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:29 smithi029 ceph-mon[31255]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 622 op/s 2024-09-19T07:18:29.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:29 smithi078 ceph-mon[34556]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 622 op/s 2024-09-19T07:18:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:29 smithi046 ceph-mon[34147]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 622 op/s 2024-09-19T07:18:31.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:31 smithi029 ceph-mon[31255]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 798 op/s 2024-09-19T07:18:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:31 smithi078 ceph-mon[34556]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 798 op/s 2024-09-19T07:18:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:31 smithi046 ceph-mon[34147]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 798 op/s 2024-09-19T07:18:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 520.0 s, 730.2 tps, lat 136.792 ms stddev 64.474 2024-09-19T07:18:33.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:33 smithi029 ceph-mon[31255]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 698 op/s 2024-09-19T07:18:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:33 smithi078 ceph-mon[34556]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 698 op/s 2024-09-19T07:18:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:33 smithi046 ceph-mon[34147]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.0 MiB/s wr, 698 op/s 2024-09-19T07:18:35.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:35 smithi029 ceph-mon[31255]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 748 op/s 2024-09-19T07:18:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:35 smithi078 ceph-mon[34556]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 748 op/s 2024-09-19T07:18:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:35 smithi046 ceph-mon[34147]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 748 op/s 2024-09-19T07:18:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 525.0 s, 740.6 tps, lat 135.076 ms stddev 51.804 2024-09-19T07:18:37.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:37 smithi029 ceph-mon[31255]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 756 op/s 2024-09-19T07:18:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:37 smithi078 ceph-mon[34556]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 756 op/s 2024-09-19T07:18:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:37 smithi046 ceph-mon[34147]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 756 op/s 2024-09-19T07:18:39.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:39 smithi029 ceph-mon[31255]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 624 op/s 2024-09-19T07:18:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:39 smithi078 ceph-mon[34556]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 624 op/s 2024-09-19T07:18:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:39 smithi046 ceph-mon[34147]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.3 MiB/s wr, 624 op/s 2024-09-19T07:18:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:41 smithi078 ceph-mon[34556]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 818 op/s 2024-09-19T07:18:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:41 smithi046 ceph-mon[34147]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 818 op/s 2024-09-19T07:18:42.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:41 smithi029 ceph-mon[31255]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.1 MiB/s wr, 818 op/s 2024-09-19T07:18:42.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 530.0 s, 790.1 tps, lat 126.205 ms stddev 62.384 2024-09-19T07:18:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:43 smithi078 ceph-mon[34556]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 715 op/s 2024-09-19T07:18:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:43 smithi046 ceph-mon[34147]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 715 op/s 2024-09-19T07:18:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:43 smithi029 ceph-mon[31255]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 715 op/s 2024-09-19T07:18:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:45 smithi078 ceph-mon[34556]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.4 MiB/s wr, 741 op/s 2024-09-19T07:18:45.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:45 smithi046 ceph-mon[34147]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.4 MiB/s wr, 741 op/s 2024-09-19T07:18:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:45 smithi029 ceph-mon[31255]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.4 MiB/s wr, 741 op/s 2024-09-19T07:18:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 535.0 s, 799.0 tps, lat 125.588 ms stddev 66.882 2024-09-19T07:18:47.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:47 smithi078 ceph-mon[34556]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.6 MiB/s wr, 769 op/s 2024-09-19T07:18:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:47 smithi046 ceph-mon[34147]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.6 MiB/s wr, 769 op/s 2024-09-19T07:18:48.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:47 smithi029 ceph-mon[31255]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.6 MiB/s wr, 769 op/s 2024-09-19T07:18:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:49 smithi078 ceph-mon[34556]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 670 op/s 2024-09-19T07:18:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:49 smithi046 ceph-mon[34147]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 670 op/s 2024-09-19T07:18:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:49 smithi029 ceph-mon[31255]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 670 op/s 2024-09-19T07:18:50.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:50 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:50.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:50 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:51.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:50 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:51.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:51 smithi078 ceph-mon[34556]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.4 MiB/s wr, 854 op/s 2024-09-19T07:18:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:51 smithi046 ceph-mon[34147]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.4 MiB/s wr, 854 op/s 2024-09-19T07:18:52.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:51 smithi029 ceph-mon[31255]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.4 MiB/s wr, 854 op/s 2024-09-19T07:18:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 540.0 s, 705.6 tps, lat 140.095 ms stddev 92.353 2024-09-19T07:18:53.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:53 smithi046 ceph-mon[34147]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 734 op/s 2024-09-19T07:18:53.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:53 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:53 smithi029 ceph-mon[31255]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 734 op/s 2024-09-19T07:18:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:53 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:53 smithi078 ceph-mon[34556]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 734 op/s 2024-09-19T07:18:53.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:53.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:53 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:18:55.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:55 smithi046 ceph-mon[34147]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 777 op/s 2024-09-19T07:18:55.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:55 smithi029 ceph-mon[31255]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 777 op/s 2024-09-19T07:18:55.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:55 smithi078 ceph-mon[34556]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 777 op/s 2024-09-19T07:18:57.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 545.0 s, 698.4 tps, lat 144.751 ms stddev 103.345 2024-09-19T07:18:57.477 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:57 smithi046 ceph-mon[34147]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 778 op/s 2024-09-19T07:18:57.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:57 smithi029 ceph-mon[31255]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 778 op/s 2024-09-19T07:18:57.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:57 smithi078 ceph-mon[34556]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 778 op/s 2024-09-19T07:18:59.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:18:59 smithi046 ceph-mon[34147]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.4 MiB/s wr, 630 op/s 2024-09-19T07:18:59.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:18:59 smithi029 ceph-mon[31255]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.4 MiB/s wr, 630 op/s 2024-09-19T07:18:59.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:18:59 smithi078 ceph-mon[34556]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.4 MiB/s wr, 630 op/s 2024-09-19T07:19:01.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:01 smithi046 ceph-mon[34147]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.9 MiB/s wr, 794 op/s 2024-09-19T07:19:01.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:01 smithi029 ceph-mon[31255]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.9 MiB/s wr, 794 op/s 2024-09-19T07:19:01.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:01 smithi078 ceph-mon[34556]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.9 MiB/s wr, 794 op/s 2024-09-19T07:19:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 550.0 s, 734.0 tps, lat 135.728 ms stddev 76.842 2024-09-19T07:19:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:03 smithi029 ceph-mon[31255]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 699 op/s 2024-09-19T07:19:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:03.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:03 smithi078 ceph-mon[34556]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 699 op/s 2024-09-19T07:19:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:03.946 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:03 smithi046 ceph-mon[34147]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 699 op/s 2024-09-19T07:19:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:19:05.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:05 smithi029 ceph-mon[31255]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 713 op/s 2024-09-19T07:19:05.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:05 smithi078 ceph-mon[34556]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 713 op/s 2024-09-19T07:19:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:05 smithi046 ceph-mon[34147]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 713 op/s 2024-09-19T07:19:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 555.0 s, 838.2 tps, lat 119.836 ms stddev 51.657 2024-09-19T07:19:07.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:07 smithi029 ceph-mon[31255]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 727 op/s 2024-09-19T07:19:07.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:07 smithi078 ceph-mon[34556]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 727 op/s 2024-09-19T07:19:07.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:07 smithi046 ceph-mon[34147]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.5 MiB/s wr, 727 op/s 2024-09-19T07:19:09.873 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:09 smithi029 ceph-mon[31255]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 637 op/s 2024-09-19T07:19:09.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:09 smithi078 ceph-mon[34556]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 637 op/s 2024-09-19T07:19:09.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:09 smithi046 ceph-mon[34147]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.4 MiB/s wr, 637 op/s 2024-09-19T07:19:11.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:11 smithi029 ceph-mon[31255]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 844 op/s 2024-09-19T07:19:11.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:11 smithi078 ceph-mon[34556]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 844 op/s 2024-09-19T07:19:11.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:11 smithi046 ceph-mon[34147]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 844 op/s 2024-09-19T07:19:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 560.0 s, 876.7 tps, lat 114.268 ms stddev 45.699 2024-09-19T07:19:13.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:13 smithi078 ceph-mon[34556]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.4 MiB/s wr, 773 op/s 2024-09-19T07:19:13.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:13 smithi046 ceph-mon[34147]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.4 MiB/s wr, 773 op/s 2024-09-19T07:19:14.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:13 smithi029 ceph-mon[31255]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 9.4 MiB/s wr, 773 op/s 2024-09-19T07:19:15.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:15 smithi078 ceph-mon[34556]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 818 op/s 2024-09-19T07:19:15.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:15 smithi046 ceph-mon[34147]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 818 op/s 2024-09-19T07:19:16.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:15 smithi029 ceph-mon[31255]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 818 op/s 2024-09-19T07:19:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 565.0 s, 857.0 tps, lat 116.969 ms stddev 132.044 2024-09-19T07:19:17.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:17 smithi078 ceph-mon[34556]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-09-19T07:19:17.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:17 smithi046 ceph-mon[34147]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-09-19T07:19:18.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:17 smithi029 ceph-mon[31255]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-09-19T07:19:19.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:19 smithi078 ceph-mon[34556]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 11 MiB/s wr, 740 op/s 2024-09-19T07:19:19.977 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:19 smithi046 ceph-mon[34147]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 11 MiB/s wr, 740 op/s 2024-09-19T07:19:20.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:19 smithi029 ceph-mon[31255]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 11 MiB/s wr, 740 op/s 2024-09-19T07:19:21.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:21 smithi078 ceph-mon[34556]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 915 op/s 2024-09-19T07:19:21.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:21 smithi046 ceph-mon[34147]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 915 op/s 2024-09-19T07:19:22.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:21 smithi029 ceph-mon[31255]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 15 MiB/s wr, 915 op/s 2024-09-19T07:19:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 570.0 s, 761.2 tps, lat 130.562 ms stddev 108.640 2024-09-19T07:19:23.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:23 smithi078 ceph-mon[34556]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-19T07:19:23.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:23 smithi046 ceph-mon[34147]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-19T07:19:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:23 smithi029 ceph-mon[31255]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-19T07:19:25.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:25 smithi078 ceph-mon[34556]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 14 MiB/s wr, 814 op/s 2024-09-19T07:19:25.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:25 smithi046 ceph-mon[34147]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 14 MiB/s wr, 814 op/s 2024-09-19T07:19:26.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:25 smithi029 ceph-mon[31255]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 14 MiB/s wr, 814 op/s 2024-09-19T07:19:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 575.0 s, 874.6 tps, lat 113.429 ms stddev 80.022 2024-09-19T07:19:27.926 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:27 smithi029 ceph-mon[31255]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-09-19T07:19:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:27 smithi078 ceph-mon[34556]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-09-19T07:19:27.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:27 smithi046 ceph-mon[34147]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-09-19T07:19:29.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:29 smithi078 ceph-mon[34556]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 661 op/s 2024-09-19T07:19:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:29 smithi046 ceph-mon[34147]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 661 op/s 2024-09-19T07:19:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:29 smithi029 ceph-mon[31255]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 661 op/s 2024-09-19T07:19:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:31 smithi078 ceph-mon[34556]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 836 op/s 2024-09-19T07:19:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:31 smithi046 ceph-mon[34147]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 836 op/s 2024-09-19T07:19:32.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:31 smithi029 ceph-mon[31255]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 13 MiB/s wr, 836 op/s 2024-09-19T07:19:32.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 580.0 s, 790.9 tps, lat 128.544 ms stddev 129.618 2024-09-19T07:19:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:33 smithi078 ceph-mon[34556]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 746 op/s 2024-09-19T07:19:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:33 smithi046 ceph-mon[34147]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 746 op/s 2024-09-19T07:19:34.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:33 smithi029 ceph-mon[31255]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 746 op/s 2024-09-19T07:19:35.948 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:35 smithi078 ceph-mon[34556]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 770 op/s 2024-09-19T07:19:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:35 smithi046 ceph-mon[34147]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 770 op/s 2024-09-19T07:19:36.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:35 smithi029 ceph-mon[31255]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 770 op/s 2024-09-19T07:19:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 585.0 s, 811.7 tps, lat 122.663 ms stddev 117.632 2024-09-19T07:19:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:37 smithi078 ceph-mon[34556]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 804 op/s 2024-09-19T07:19:37.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:37 smithi046 ceph-mon[34147]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 804 op/s 2024-09-19T07:19:38.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:37 smithi029 ceph-mon[31255]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 804 op/s 2024-09-19T07:19:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:39 smithi078 ceph-mon[34556]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.6 MiB/s wr, 705 op/s 2024-09-19T07:19:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:39 smithi046 ceph-mon[34147]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.6 MiB/s wr, 705 op/s 2024-09-19T07:19:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:39 smithi029 ceph-mon[31255]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.6 MiB/s wr, 705 op/s 2024-09-19T07:19:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:41 smithi078 ceph-mon[34556]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 13 MiB/s wr, 909 op/s 2024-09-19T07:19:41.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:41 smithi046 ceph-mon[34147]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 13 MiB/s wr, 909 op/s 2024-09-19T07:19:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:41 smithi029 ceph-mon[31255]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 13 MiB/s wr, 909 op/s 2024-09-19T07:19:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 590.0 s, 871.6 tps, lat 114.927 ms stddev 74.455 2024-09-19T07:19:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:43 smithi046 ceph-mon[34147]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 847 op/s 2024-09-19T07:19:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:43 smithi029 ceph-mon[31255]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 847 op/s 2024-09-19T07:19:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:43 smithi078 ceph-mon[34556]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 847 op/s 2024-09-19T07:19:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:45 smithi046 ceph-mon[34147]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 808 op/s 2024-09-19T07:19:46.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:45 smithi029 ceph-mon[31255]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 808 op/s 2024-09-19T07:19:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:45 smithi078 ceph-mon[34556]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 808 op/s 2024-09-19T07:19:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 595.0 s, 784.9 tps, lat 126.453 ms stddev 126.272 2024-09-19T07:19:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:47 smithi046 ceph-mon[34147]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 803 op/s 2024-09-19T07:19:48.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:47 smithi029 ceph-mon[31255]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 803 op/s 2024-09-19T07:19:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:47 smithi078 ceph-mon[34556]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 803 op/s 2024-09-19T07:19:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:49 smithi046 ceph-mon[34147]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 10 MiB/s wr, 714 op/s 2024-09-19T07:19:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:49 smithi029 ceph-mon[31255]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 10 MiB/s wr, 714 op/s 2024-09-19T07:19:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:49 smithi078 ceph-mon[34556]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 10 MiB/s wr, 714 op/s 2024-09-19T07:19:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:51 smithi046 ceph-mon[34147]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-19T07:19:52.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:51 smithi029 ceph-mon[31255]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-19T07:19:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:51 smithi078 ceph-mon[34556]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-09-19T07:19:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 600.0 s, 721.0 tps, lat 138.875 ms stddev 117.823 2024-09-19T07:19:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:53 smithi046 ceph-mon[34147]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.3 MiB/s wr, 735 op/s 2024-09-19T07:19:53.996 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:53 smithi078 ceph-mon[34556]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.3 MiB/s wr, 735 op/s 2024-09-19T07:19:54.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:53 smithi029 ceph-mon[31255]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 9.3 MiB/s wr, 735 op/s 2024-09-19T07:19:55.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:55 smithi046 ceph-mon[34147]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.4 MiB/s wr, 671 op/s 2024-09-19T07:19:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:55 smithi029 ceph-mon[31255]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.4 MiB/s wr, 671 op/s 2024-09-19T07:19:56.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:55 smithi078 ceph-mon[34556]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.4 MiB/s wr, 671 op/s 2024-09-19T07:19:57.299 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 605.0 s, 835.7 tps, lat 119.693 ms stddev 79.902 2024-09-19T07:19:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:57 smithi046 ceph-mon[34147]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.9 MiB/s wr, 752 op/s 2024-09-19T07:19:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:57 smithi029 ceph-mon[31255]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.9 MiB/s wr, 752 op/s 2024-09-19T07:19:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:57 smithi078 ceph-mon[34556]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.9 MiB/s wr, 752 op/s 2024-09-19T07:20:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:19:59 smithi029 ceph-mon[31255]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.9 MiB/s wr, 694 op/s 2024-09-19T07:20:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:19:59 smithi078 ceph-mon[34556]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.9 MiB/s wr, 694 op/s 2024-09-19T07:20:00.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:19:59 smithi046 ceph-mon[34147]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.9 MiB/s wr, 694 op/s 2024-09-19T07:20:00.874 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:00 smithi029 ceph-mon[31255]: overall HEALTH_OK 2024-09-19T07:20:01.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:00 smithi078 ceph-mon[34556]: overall HEALTH_OK 2024-09-19T07:20:01.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:00 smithi046 ceph-mon[34147]: overall HEALTH_OK 2024-09-19T07:20:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:01 smithi029 ceph-mon[31255]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.4 MiB/s wr, 761 op/s 2024-09-19T07:20:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:01 smithi078 ceph-mon[34556]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.4 MiB/s wr, 761 op/s 2024-09-19T07:20:02.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:01 smithi046 ceph-mon[34147]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.4 MiB/s wr, 761 op/s 2024-09-19T07:20:02.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 610.0 s, 832.6 tps, lat 120.399 ms stddev 70.073 2024-09-19T07:20:03.995 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:03 smithi029 ceph-mon[31255]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 797 op/s 2024-09-19T07:20:03.996 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:03 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:03 smithi078 ceph-mon[34556]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 797 op/s 2024-09-19T07:20:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:03 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:04.228 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:03 smithi046 ceph-mon[34147]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 10 MiB/s wr, 797 op/s 2024-09-19T07:20:04.228 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:03 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:05 smithi029 ceph-mon[31255]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.2 MiB/s wr, 734 op/s 2024-09-19T07:20:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:05.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:05 smithi078 ceph-mon[34556]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.2 MiB/s wr, 734 op/s 2024-09-19T07:20:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:05.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:05.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:05 smithi046 ceph-mon[34147]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.2 MiB/s wr, 734 op/s 2024-09-19T07:20:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:05.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:20:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 615.0 s, 768.3 tps, lat 130.200 ms stddev 87.730 2024-09-19T07:20:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:07 smithi046 ceph-mon[34147]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.8 MiB/s wr, 793 op/s 2024-09-19T07:20:07.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:07 smithi029 ceph-mon[31255]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.8 MiB/s wr, 793 op/s 2024-09-19T07:20:07.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:07 smithi078 ceph-mon[34556]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.8 MiB/s wr, 793 op/s 2024-09-19T07:20:09.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:09 smithi046 ceph-mon[34147]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.3 MiB/s wr, 710 op/s 2024-09-19T07:20:09.481 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:09 smithi029 ceph-mon[31255]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.3 MiB/s wr, 710 op/s 2024-09-19T07:20:09.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:09 smithi078 ceph-mon[34556]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 8.3 MiB/s wr, 710 op/s 2024-09-19T07:20:11.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:11 smithi046 ceph-mon[34147]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.3 MiB/s wr, 777 op/s 2024-09-19T07:20:11.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:11 smithi029 ceph-mon[31255]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.3 MiB/s wr, 777 op/s 2024-09-19T07:20:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:11 smithi078 ceph-mon[34556]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 9.3 MiB/s wr, 777 op/s 2024-09-19T07:20:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 620.0 s, 760.8 tps, lat 129.772 ms stddev 93.743 2024-09-19T07:20:13.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:13 smithi046 ceph-mon[34147]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.0 MiB/s wr, 780 op/s 2024-09-19T07:20:13.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:13 smithi029 ceph-mon[31255]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.0 MiB/s wr, 780 op/s 2024-09-19T07:20:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:13 smithi078 ceph-mon[34556]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 9.0 MiB/s wr, 780 op/s 2024-09-19T07:20:15.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:15 smithi029 ceph-mon[31255]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.7 MiB/s wr, 684 op/s 2024-09-19T07:20:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:15 smithi078 ceph-mon[34556]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.7 MiB/s wr, 684 op/s 2024-09-19T07:20:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:15 smithi046 ceph-mon[34147]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.7 MiB/s wr, 684 op/s 2024-09-19T07:20:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 625.0 s, 612.0 tps, lat 139.426 ms stddev 98.010 2024-09-19T07:20:17.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:17 smithi029 ceph-mon[31255]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-09-19T07:20:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:17 smithi078 ceph-mon[34556]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-09-19T07:20:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:17 smithi046 ceph-mon[34147]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 MiB/s wr, 746 op/s 2024-09-19T07:20:19.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:19 smithi029 ceph-mon[31255]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.8 MiB/s wr, 692 op/s 2024-09-19T07:20:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:19 smithi078 ceph-mon[34556]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.8 MiB/s wr, 692 op/s 2024-09-19T07:20:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:19 smithi046 ceph-mon[34147]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.8 MiB/s wr, 692 op/s 2024-09-19T07:20:21.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:21 smithi029 ceph-mon[31255]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2024-09-19T07:20:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:21 smithi078 ceph-mon[34556]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2024-09-19T07:20:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:21 smithi046 ceph-mon[34147]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2024-09-19T07:20:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 630.0 s, 905.4 tps, lat 128.059 ms stddev 151.647 2024-09-19T07:20:23.510 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:23 smithi078 ceph-mon[34556]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 784 op/s 2024-09-19T07:20:23.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:23 smithi029 ceph-mon[31255]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 784 op/s 2024-09-19T07:20:23.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:23 smithi046 ceph-mon[34147]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 784 op/s 2024-09-19T07:20:25.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:25 smithi078 ceph-mon[34556]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 729 op/s 2024-09-19T07:20:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:25 smithi029 ceph-mon[31255]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 729 op/s 2024-09-19T07:20:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:25 smithi046 ceph-mon[34147]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 9.6 MiB/s wr, 729 op/s 2024-09-19T07:20:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 635.0 s, 869.0 tps, lat 114.976 ms stddev 148.706 2024-09-19T07:20:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:27 smithi078 ceph-mon[34556]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 819 op/s 2024-09-19T07:20:27.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:27 smithi046 ceph-mon[34147]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 819 op/s 2024-09-19T07:20:28.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:27 smithi029 ceph-mon[31255]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 819 op/s 2024-09-19T07:20:29.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:29 smithi078 ceph-mon[34556]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-19T07:20:29.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:29 smithi046 ceph-mon[34147]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-19T07:20:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:29 smithi029 ceph-mon[31255]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-09-19T07:20:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:31 smithi078 ceph-mon[34556]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 816 op/s 2024-09-19T07:20:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:31 smithi046 ceph-mon[34147]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 816 op/s 2024-09-19T07:20:32.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:31 smithi029 ceph-mon[31255]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 816 op/s 2024-09-19T07:20:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 640.0 s, 759.0 tps, lat 130.255 ms stddev 160.795 2024-09-19T07:20:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:33 smithi078 ceph-mon[34556]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-19T07:20:33.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:33 smithi046 ceph-mon[34147]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-19T07:20:34.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:33 smithi029 ceph-mon[31255]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 11 MiB/s wr, 840 op/s 2024-09-19T07:20:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:35 smithi078 ceph-mon[34556]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 748 op/s 2024-09-19T07:20:35.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:35 smithi046 ceph-mon[34147]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 748 op/s 2024-09-19T07:20:36.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:35 smithi029 ceph-mon[31255]: pgmap v722: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.8 MiB/s wr, 748 op/s 2024-09-19T07:20:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 645.0 s, 905.2 tps, lat 111.957 ms stddev 59.413 2024-09-19T07:20:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:37 smithi078 ceph-mon[34556]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-19T07:20:37.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:37 smithi046 ceph-mon[34147]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-19T07:20:38.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:37 smithi029 ceph-mon[31255]: pgmap v723: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 12 MiB/s wr, 800 op/s 2024-09-19T07:20:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:39 smithi078 ceph-mon[34556]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 9.2 MiB/s wr, 703 op/s 2024-09-19T07:20:39.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:39 smithi046 ceph-mon[34147]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 9.2 MiB/s wr, 703 op/s 2024-09-19T07:20:40.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:39 smithi029 ceph-mon[31255]: pgmap v724: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 9.2 MiB/s wr, 703 op/s 2024-09-19T07:20:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:41 smithi078 ceph-mon[34556]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 10 MiB/s wr, 803 op/s 2024-09-19T07:20:41.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:41 smithi046 ceph-mon[34147]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 10 MiB/s wr, 803 op/s 2024-09-19T07:20:42.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:41 smithi029 ceph-mon[31255]: pgmap v725: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 10 MiB/s wr, 803 op/s 2024-09-19T07:20:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 650.0 s, 826.0 tps, lat 121.150 ms stddev 76.382 2024-09-19T07:20:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:43 smithi078 ceph-mon[34556]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 9.4 MiB/s wr, 820 op/s 2024-09-19T07:20:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:43 smithi046 ceph-mon[34147]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 9.4 MiB/s wr, 820 op/s 2024-09-19T07:20:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:43 smithi029 ceph-mon[31255]: pgmap v726: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 9.4 MiB/s wr, 820 op/s 2024-09-19T07:20:45.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:45 smithi078 ceph-mon[34556]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.0 MiB/s wr, 739 op/s 2024-09-19T07:20:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:45 smithi046 ceph-mon[34147]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.0 MiB/s wr, 739 op/s 2024-09-19T07:20:46.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:45 smithi029 ceph-mon[31255]: pgmap v727: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.0 MiB/s wr, 739 op/s 2024-09-19T07:20:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 655.0 s, 743.7 tps, lat 133.558 ms stddev 102.159 2024-09-19T07:20:47.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:47 smithi078 ceph-mon[34556]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 9.2 MiB/s wr, 805 op/s 2024-09-19T07:20:47.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:47 smithi046 ceph-mon[34147]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 9.2 MiB/s wr, 805 op/s 2024-09-19T07:20:48.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:47 smithi029 ceph-mon[31255]: pgmap v728: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 9.2 MiB/s wr, 805 op/s 2024-09-19T07:20:49.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:49 smithi078 ceph-mon[34556]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 740 op/s 2024-09-19T07:20:49.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:49 smithi046 ceph-mon[34147]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 740 op/s 2024-09-19T07:20:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:49 smithi029 ceph-mon[31255]: pgmap v729: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 740 op/s 2024-09-19T07:20:51.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:51 smithi078 ceph-mon[34556]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 820 op/s 2024-09-19T07:20:51.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:51 smithi046 ceph-mon[34147]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 820 op/s 2024-09-19T07:20:52.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:51 smithi029 ceph-mon[31255]: pgmap v730: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 820 op/s 2024-09-19T07:20:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 660.0 s, 827.6 tps, lat 121.252 ms stddev 60.225 2024-09-19T07:20:53.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:53 smithi078 ceph-mon[34556]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.0 MiB/s wr, 789 op/s 2024-09-19T07:20:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:53 smithi046 ceph-mon[34147]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.0 MiB/s wr, 789 op/s 2024-09-19T07:20:54.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:53 smithi029 ceph-mon[31255]: pgmap v731: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.0 MiB/s wr, 789 op/s 2024-09-19T07:20:55.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:55 smithi078 ceph-mon[34556]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.7 MiB/s wr, 718 op/s 2024-09-19T07:20:55.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:55 smithi046 ceph-mon[34147]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.7 MiB/s wr, 718 op/s 2024-09-19T07:20:56.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:55 smithi029 ceph-mon[31255]: pgmap v732: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.7 MiB/s wr, 718 op/s 2024-09-19T07:20:57.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 665.0 s, 706.0 tps, lat 141.449 ms stddev 94.699 2024-09-19T07:20:57.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:57 smithi078 ceph-mon[34556]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.1 MiB/s wr, 777 op/s 2024-09-19T07:20:57.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:57 smithi046 ceph-mon[34147]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.1 MiB/s wr, 777 op/s 2024-09-19T07:20:58.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:57 smithi029 ceph-mon[31255]: pgmap v733: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 8.1 MiB/s wr, 777 op/s 2024-09-19T07:20:59.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:20:59 smithi078 ceph-mon[34556]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 702 op/s 2024-09-19T07:20:59.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:20:59 smithi046 ceph-mon[34147]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 702 op/s 2024-09-19T07:21:00.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:20:59 smithi029 ceph-mon[31255]: pgmap v734: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 702 op/s 2024-09-19T07:21:01.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:01 smithi046 ceph-mon[34147]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 747 op/s 2024-09-19T07:21:02.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:01 smithi029 ceph-mon[31255]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 747 op/s 2024-09-19T07:21:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:01 smithi078 ceph-mon[34556]: pgmap v735: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.5 MiB/s wr, 747 op/s 2024-09-19T07:21:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 670.0 s, 784.8 tps, lat 127.038 ms stddev 78.586 2024-09-19T07:21:03.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:03 smithi046 ceph-mon[34147]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 766 op/s 2024-09-19T07:21:04.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:03 smithi029 ceph-mon[31255]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 766 op/s 2024-09-19T07:21:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:03 smithi078 ceph-mon[34556]: pgmap v736: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.7 MiB/s wr, 766 op/s 2024-09-19T07:21:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:05 smithi046 ceph-mon[34147]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 702 op/s 2024-09-19T07:21:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:05.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:05 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:05 smithi029 ceph-mon[31255]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 702 op/s 2024-09-19T07:21:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:05 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:05 smithi078 ceph-mon[34556]: pgmap v737: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 702 op/s 2024-09-19T07:21:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:05 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:06.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:06 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:07.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:07.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:07.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:06 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:07.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:07.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:07.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:06 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:21:07.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 675.0 s, 750.3 tps, lat 133.480 ms stddev 111.520 2024-09-19T07:21:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:07 smithi078 ceph-mon[34556]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 733 op/s 2024-09-19T07:21:08.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:07 smithi046 ceph-mon[34147]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 733 op/s 2024-09-19T07:21:08.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:07 smithi029 ceph-mon[31255]: pgmap v738: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.0 MiB/s wr, 733 op/s 2024-09-19T07:21:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:09 smithi078 ceph-mon[34556]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-19T07:21:10.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:09 smithi046 ceph-mon[34147]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-19T07:21:10.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:09 smithi029 ceph-mon[31255]: pgmap v739: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 677 op/s 2024-09-19T07:21:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:11 smithi078 ceph-mon[34556]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 759 op/s 2024-09-19T07:21:12.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:11 smithi046 ceph-mon[34147]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 759 op/s 2024-09-19T07:21:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 680.0 s, 809.7 tps, lat 122.714 ms stddev 82.188 2024-09-19T07:21:12.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:11 smithi029 ceph-mon[31255]: pgmap v740: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 759 op/s 2024-09-19T07:21:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:13 smithi078 ceph-mon[34556]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.0 MiB/s wr, 804 op/s 2024-09-19T07:21:14.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:13 smithi046 ceph-mon[34147]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.0 MiB/s wr, 804 op/s 2024-09-19T07:21:14.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:13 smithi029 ceph-mon[31255]: pgmap v741: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.0 MiB/s wr, 804 op/s 2024-09-19T07:21:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:15 smithi078 ceph-mon[34556]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.9 MiB/s wr, 721 op/s 2024-09-19T07:21:16.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:15 smithi046 ceph-mon[34147]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.9 MiB/s wr, 721 op/s 2024-09-19T07:21:16.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:15 smithi029 ceph-mon[31255]: pgmap v742: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.9 MiB/s wr, 721 op/s 2024-09-19T07:21:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 685.0 s, 742.6 tps, lat 135.005 ms stddev 112.280 2024-09-19T07:21:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:17 smithi078 ceph-mon[34556]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.1 MiB/s wr, 807 op/s 2024-09-19T07:21:18.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:17 smithi046 ceph-mon[34147]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.1 MiB/s wr, 807 op/s 2024-09-19T07:21:18.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:17 smithi029 ceph-mon[31255]: pgmap v743: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 8.1 MiB/s wr, 807 op/s 2024-09-19T07:21:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:19 smithi078 ceph-mon[34556]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.9 MiB/s wr, 741 op/s 2024-09-19T07:21:20.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:19 smithi046 ceph-mon[34147]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.9 MiB/s wr, 741 op/s 2024-09-19T07:21:20.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:19 smithi029 ceph-mon[31255]: pgmap v744: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.9 MiB/s wr, 741 op/s 2024-09-19T07:21:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:21 smithi078 ceph-mon[34556]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.0 MiB/s wr, 781 op/s 2024-09-19T07:21:22.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:21 smithi046 ceph-mon[34147]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.0 MiB/s wr, 781 op/s 2024-09-19T07:21:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 690.0 s, 829.2 tps, lat 121.304 ms stddev 82.102 2024-09-19T07:21:22.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:21 smithi029 ceph-mon[31255]: pgmap v745: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 8.0 MiB/s wr, 781 op/s 2024-09-19T07:21:24.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:23 smithi078 ceph-mon[34556]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.5 MiB/s wr, 813 op/s 2024-09-19T07:21:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:23 smithi046 ceph-mon[34147]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.5 MiB/s wr, 813 op/s 2024-09-19T07:21:24.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:23 smithi029 ceph-mon[31255]: pgmap v746: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.5 MiB/s wr, 813 op/s 2024-09-19T07:21:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:25 smithi078 ceph-mon[34556]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.9 MiB/s wr, 737 op/s 2024-09-19T07:21:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:25 smithi046 ceph-mon[34147]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.9 MiB/s wr, 737 op/s 2024-09-19T07:21:26.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:25 smithi029 ceph-mon[31255]: pgmap v747: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.9 MiB/s wr, 737 op/s 2024-09-19T07:21:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 695.0 s, 855.2 tps, lat 117.232 ms stddev 59.119 2024-09-19T07:21:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:27 smithi078 ceph-mon[34556]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 785 op/s 2024-09-19T07:21:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:27 smithi046 ceph-mon[34147]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 785 op/s 2024-09-19T07:21:28.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:27 smithi029 ceph-mon[31255]: pgmap v748: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.3 MiB/s wr, 785 op/s 2024-09-19T07:21:30.176 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:29 smithi029 ceph-mon[31255]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 699 op/s 2024-09-19T07:21:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:29 smithi078 ceph-mon[34556]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 699 op/s 2024-09-19T07:21:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:29 smithi046 ceph-mon[34147]: pgmap v749: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.2 MiB/s wr, 699 op/s 2024-09-19T07:21:32.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:31 smithi078 ceph-mon[34556]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.5 MiB/s wr, 773 op/s 2024-09-19T07:21:32.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:31 smithi046 ceph-mon[34147]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.5 MiB/s wr, 773 op/s 2024-09-19T07:21:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 700.0 s, 723.7 tps, lat 138.737 ms stddev 117.928 2024-09-19T07:21:32.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:31 smithi029 ceph-mon[31255]: pgmap v750: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.5 MiB/s wr, 773 op/s 2024-09-19T07:21:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:33 smithi078 ceph-mon[34556]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.1 MiB/s wr, 807 op/s 2024-09-19T07:21:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:33 smithi046 ceph-mon[34147]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.1 MiB/s wr, 807 op/s 2024-09-19T07:21:34.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:33 smithi029 ceph-mon[31255]: pgmap v751: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.1 MiB/s wr, 807 op/s 2024-09-19T07:21:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:35 smithi078 ceph-mon[34556]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 692 op/s 2024-09-19T07:21:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:35 smithi046 ceph-mon[34147]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 692 op/s 2024-09-19T07:21:36.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:35 smithi029 ceph-mon[31255]: pgmap v752: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 692 op/s 2024-09-19T07:21:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 705.0 s, 932.9 tps, lat 106.081 ms stddev 70.434 2024-09-19T07:21:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:37 smithi078 ceph-mon[34556]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 MiB/s wr, 767 op/s 2024-09-19T07:21:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:37 smithi046 ceph-mon[34147]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 MiB/s wr, 767 op/s 2024-09-19T07:21:38.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:37 smithi029 ceph-mon[31255]: pgmap v753: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 7.2 MiB/s wr, 767 op/s 2024-09-19T07:21:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:39 smithi078 ceph-mon[34556]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 713 op/s 2024-09-19T07:21:40.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:39 smithi046 ceph-mon[34147]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 713 op/s 2024-09-19T07:21:40.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:39 smithi029 ceph-mon[31255]: pgmap v754: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 713 op/s 2024-09-19T07:21:42.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:41 smithi046 ceph-mon[34147]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.8 MiB/s wr, 805 op/s 2024-09-19T07:21:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 710.0 s, 878.8 tps, lat 114.054 ms stddev 67.663 2024-09-19T07:21:42.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:41 smithi029 ceph-mon[31255]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.8 MiB/s wr, 805 op/s 2024-09-19T07:21:42.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:41 smithi078 ceph-mon[34556]: pgmap v755: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.8 MiB/s wr, 805 op/s 2024-09-19T07:21:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:43 smithi046 ceph-mon[34147]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 834 op/s 2024-09-19T07:21:44.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:43 smithi029 ceph-mon[31255]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 834 op/s 2024-09-19T07:21:44.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:43 smithi078 ceph-mon[34556]: pgmap v756: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 7.9 MiB/s wr, 834 op/s 2024-09-19T07:21:46.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:45 smithi046 ceph-mon[34147]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 766 op/s 2024-09-19T07:21:46.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:45 smithi029 ceph-mon[31255]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 766 op/s 2024-09-19T07:21:46.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:45 smithi078 ceph-mon[34556]: pgmap v757: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.1 MiB/s wr, 766 op/s 2024-09-19T07:21:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 715.0 s, 808.6 tps, lat 123.342 ms stddev 93.813 2024-09-19T07:21:48.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:47 smithi046 ceph-mon[34147]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 852 op/s 2024-09-19T07:21:48.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:47 smithi029 ceph-mon[31255]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 852 op/s 2024-09-19T07:21:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:47 smithi078 ceph-mon[34556]: pgmap v758: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.0 MiB/s wr, 852 op/s 2024-09-19T07:21:50.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:49 smithi046 ceph-mon[34147]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 758 op/s 2024-09-19T07:21:50.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:49 smithi029 ceph-mon[31255]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 758 op/s 2024-09-19T07:21:50.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:49 smithi078 ceph-mon[34556]: pgmap v759: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 758 op/s 2024-09-19T07:21:52.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:51 smithi046 ceph-mon[34147]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 844 op/s 2024-09-19T07:21:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 720.0 s, 852.2 tps, lat 117.573 ms stddev 75.833 2024-09-19T07:21:52.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:51 smithi029 ceph-mon[31255]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 844 op/s 2024-09-19T07:21:52.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:51 smithi078 ceph-mon[34556]: pgmap v760: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 8.0 MiB/s wr, 844 op/s 2024-09-19T07:21:54.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:53 smithi046 ceph-mon[34147]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 833 op/s 2024-09-19T07:21:54.246 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:53 smithi078 ceph-mon[34556]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 833 op/s 2024-09-19T07:21:54.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:53 smithi029 ceph-mon[31255]: pgmap v761: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.5 MiB/s wr, 833 op/s 2024-09-19T07:21:56.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:55 smithi046 ceph-mon[34147]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 750 op/s 2024-09-19T07:21:56.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:55 smithi029 ceph-mon[31255]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 750 op/s 2024-09-19T07:21:56.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:55 smithi078 ceph-mon[34556]: pgmap v762: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 750 op/s 2024-09-19T07:21:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 725.0 s, 822.4 tps, lat 122.085 ms stddev 57.784 2024-09-19T07:21:58.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:57 smithi029 ceph-mon[31255]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.6 MiB/s wr, 816 op/s 2024-09-19T07:21:58.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:57 smithi078 ceph-mon[34556]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.6 MiB/s wr, 816 op/s 2024-09-19T07:21:58.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:57 smithi046 ceph-mon[34147]: pgmap v763: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.6 MiB/s wr, 816 op/s 2024-09-19T07:22:00.276 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:21:59 smithi046 ceph-mon[34147]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.7 MiB/s wr, 724 op/s 2024-09-19T07:22:00.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:21:59 smithi029 ceph-mon[31255]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.7 MiB/s wr, 724 op/s 2024-09-19T07:22:00.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:21:59 smithi078 ceph-mon[34556]: pgmap v764: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.7 MiB/s wr, 724 op/s 2024-09-19T07:22:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 730.0 s, 825.0 tps, lat 121.077 ms stddev 106.171 2024-09-19T07:22:02.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:01 smithi029 ceph-mon[31255]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.3 MiB/s wr, 794 op/s 2024-09-19T07:22:02.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:01 smithi078 ceph-mon[34556]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.3 MiB/s wr, 794 op/s 2024-09-19T07:22:02.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:01 smithi046 ceph-mon[34147]: pgmap v765: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 7.3 MiB/s wr, 794 op/s 2024-09-19T07:22:04.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:03 smithi029 ceph-mon[31255]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 827 op/s 2024-09-19T07:22:04.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:03 smithi078 ceph-mon[34556]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 827 op/s 2024-09-19T07:22:04.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:03 smithi046 ceph-mon[34147]: pgmap v766: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 827 op/s 2024-09-19T07:22:06.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:06 smithi029 ceph-mon[31255]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 765 op/s 2024-09-19T07:22:06.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:06 smithi078 ceph-mon[34556]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 765 op/s 2024-09-19T07:22:06.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:06 smithi046 ceph-mon[34147]: pgmap v767: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.2 MiB/s wr, 765 op/s 2024-09-19T07:22:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 735.0 s, 785.8 tps, lat 126.776 ms stddev 90.610 2024-09-19T07:22:07.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:07.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:22:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:22:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:22:08.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:08 smithi029 ceph-mon[31255]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 802 op/s 2024-09-19T07:22:08.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:08 smithi078 ceph-mon[34556]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 802 op/s 2024-09-19T07:22:08.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:08 smithi046 ceph-mon[34147]: pgmap v768: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 802 op/s 2024-09-19T07:22:09.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:09 smithi029 ceph-mon[31255]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 720 op/s 2024-09-19T07:22:09.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:09 smithi078 ceph-mon[34556]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 720 op/s 2024-09-19T07:22:09.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:09 smithi046 ceph-mon[34147]: pgmap v769: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.4 MiB/s wr, 720 op/s 2024-09-19T07:22:11.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:11 smithi029 ceph-mon[31255]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 815 op/s 2024-09-19T07:22:11.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:11 smithi078 ceph-mon[34556]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 815 op/s 2024-09-19T07:22:11.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:11 smithi046 ceph-mon[34147]: pgmap v770: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 815 op/s 2024-09-19T07:22:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 740.0 s, 787.0 tps, lat 126.840 ms stddev 77.642 2024-09-19T07:22:13.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:13 smithi029 ceph-mon[31255]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.5 MiB/s wr, 821 op/s 2024-09-19T07:22:13.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:13 smithi078 ceph-mon[34556]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.5 MiB/s wr, 821 op/s 2024-09-19T07:22:13.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:13 smithi046 ceph-mon[34147]: pgmap v771: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.5 MiB/s wr, 821 op/s 2024-09-19T07:22:15.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:15 smithi029 ceph-mon[31255]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 716 op/s 2024-09-19T07:22:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:15 smithi078 ceph-mon[34556]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 716 op/s 2024-09-19T07:22:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:15 smithi046 ceph-mon[34147]: pgmap v772: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 716 op/s 2024-09-19T07:22:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 745.0 s, 780.4 tps, lat 128.394 ms stddev 84.638 2024-09-19T07:22:17.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:17 smithi029 ceph-mon[31255]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.9 MiB/s wr, 775 op/s 2024-09-19T07:22:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:17 smithi078 ceph-mon[34556]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.9 MiB/s wr, 775 op/s 2024-09-19T07:22:17.724 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:17 smithi046 ceph-mon[34147]: pgmap v773: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.9 MiB/s wr, 775 op/s 2024-09-19T07:22:19.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:19 smithi029 ceph-mon[31255]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.9 MiB/s wr, 714 op/s 2024-09-19T07:22:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:19 smithi078 ceph-mon[34556]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.9 MiB/s wr, 714 op/s 2024-09-19T07:22:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:19 smithi046 ceph-mon[34147]: pgmap v774: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.9 MiB/s wr, 714 op/s 2024-09-19T07:22:21.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:21 smithi029 ceph-mon[31255]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-19T07:22:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:21 smithi078 ceph-mon[34556]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-19T07:22:21.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:21 smithi046 ceph-mon[34147]: pgmap v775: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-19T07:22:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 750.0 s, 723.8 tps, lat 137.594 ms stddev 90.990 2024-09-19T07:22:23.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:23 smithi029 ceph-mon[31255]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.4 MiB/s wr, 765 op/s 2024-09-19T07:22:23.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:23 smithi078 ceph-mon[34556]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.4 MiB/s wr, 765 op/s 2024-09-19T07:22:23.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:23 smithi046 ceph-mon[34147]: pgmap v776: 129 pgs: 129 active+clean; 1.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.4 MiB/s wr, 765 op/s 2024-09-19T07:22:25.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:25 smithi029 ceph-mon[31255]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-19T07:22:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:25 smithi078 ceph-mon[34556]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-19T07:22:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:25 smithi046 ceph-mon[34147]: pgmap v777: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.7 MiB/s wr, 682 op/s 2024-09-19T07:22:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 755.0 s, 732.4 tps, lat 136.730 ms stddev 76.382 2024-09-19T07:22:27.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:27 smithi078 ceph-mon[34556]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.9 MiB/s wr, 718 op/s 2024-09-19T07:22:27.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:27 smithi046 ceph-mon[34147]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.9 MiB/s wr, 718 op/s 2024-09-19T07:22:28.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:27 smithi029 ceph-mon[31255]: pgmap v778: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.9 MiB/s wr, 718 op/s 2024-09-19T07:22:29.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:29 smithi078 ceph-mon[34556]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 634 op/s 2024-09-19T07:22:29.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:29 smithi046 ceph-mon[34147]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 634 op/s 2024-09-19T07:22:30.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:29 smithi029 ceph-mon[31255]: pgmap v779: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.1 MiB/s wr, 634 op/s 2024-09-19T07:22:31.926 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:31 smithi029 ceph-mon[31255]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 713 op/s 2024-09-19T07:22:31.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:31 smithi078 ceph-mon[34556]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 713 op/s 2024-09-19T07:22:31.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:31 smithi046 ceph-mon[34147]: pgmap v780: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.5 MiB/s wr, 713 op/s 2024-09-19T07:22:32.299 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 760.0 s, 741.5 tps, lat 132.237 ms stddev 76.600 2024-09-19T07:22:33.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:33 smithi078 ceph-mon[34556]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.6 MiB/s wr, 728 op/s 2024-09-19T07:22:33.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:33 smithi046 ceph-mon[34147]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.6 MiB/s wr, 728 op/s 2024-09-19T07:22:34.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:33 smithi029 ceph-mon[31255]: pgmap v781: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 6.6 MiB/s wr, 728 op/s 2024-09-19T07:22:35.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:35 smithi078 ceph-mon[34556]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 637 op/s 2024-09-19T07:22:35.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:35 smithi046 ceph-mon[34147]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 637 op/s 2024-09-19T07:22:36.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:35 smithi029 ceph-mon[31255]: pgmap v782: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 637 op/s 2024-09-19T07:22:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 765.0 s, 811.5 tps, lat 124.351 ms stddev 67.511 2024-09-19T07:22:37.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:37 smithi078 ceph-mon[34556]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 729 op/s 2024-09-19T07:22:37.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:37 smithi046 ceph-mon[34147]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 729 op/s 2024-09-19T07:22:38.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:37 smithi029 ceph-mon[31255]: pgmap v783: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.6 MiB/s wr, 729 op/s 2024-09-19T07:22:39.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:39 smithi078 ceph-mon[34556]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-09-19T07:22:39.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:39 smithi046 ceph-mon[34147]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-09-19T07:22:40.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:39 smithi029 ceph-mon[31255]: pgmap v784: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 676 op/s 2024-09-19T07:22:41.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:41 smithi078 ceph-mon[34556]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 755 op/s 2024-09-19T07:22:41.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:41 smithi046 ceph-mon[34147]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 755 op/s 2024-09-19T07:22:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:41 smithi029 ceph-mon[31255]: pgmap v785: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 755 op/s 2024-09-19T07:22:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 770.0 s, 819.4 tps, lat 124.044 ms stddev 63.585 2024-09-19T07:22:43.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:43 smithi046 ceph-mon[34147]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 762 op/s 2024-09-19T07:22:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:43 smithi029 ceph-mon[31255]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 762 op/s 2024-09-19T07:22:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:43 smithi078 ceph-mon[34556]: pgmap v786: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.6 MiB/s wr, 762 op/s 2024-09-19T07:22:45.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:45 smithi046 ceph-mon[34147]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 722 op/s 2024-09-19T07:22:46.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:45 smithi029 ceph-mon[31255]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 722 op/s 2024-09-19T07:22:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:45 smithi078 ceph-mon[34556]: pgmap v787: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 722 op/s 2024-09-19T07:22:47.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 775.0 s, 693.6 tps, lat 141.239 ms stddev 110.483 2024-09-19T07:22:47.974 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:47 smithi046 ceph-mon[34147]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 780 op/s 2024-09-19T07:22:48.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:47 smithi029 ceph-mon[31255]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 780 op/s 2024-09-19T07:22:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:47 smithi078 ceph-mon[34556]: pgmap v788: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 780 op/s 2024-09-19T07:22:49.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:49 smithi046 ceph-mon[34147]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.3 MiB/s wr, 706 op/s 2024-09-19T07:22:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:49 smithi029 ceph-mon[31255]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.3 MiB/s wr, 706 op/s 2024-09-19T07:22:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:49 smithi078 ceph-mon[34556]: pgmap v789: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.3 MiB/s wr, 706 op/s 2024-09-19T07:22:51.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:51 smithi046 ceph-mon[34147]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.7 MiB/s wr, 754 op/s 2024-09-19T07:22:52.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:51 smithi029 ceph-mon[31255]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.7 MiB/s wr, 754 op/s 2024-09-19T07:22:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:51 smithi078 ceph-mon[34556]: pgmap v790: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.7 MiB/s wr, 754 op/s 2024-09-19T07:22:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 780.0 s, 700.8 tps, lat 145.167 ms stddev 135.696 2024-09-19T07:22:53.975 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:53 smithi046 ceph-mon[34147]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 755 op/s 2024-09-19T07:22:54.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:53 smithi029 ceph-mon[31255]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 755 op/s 2024-09-19T07:22:54.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:53 smithi078 ceph-mon[34556]: pgmap v791: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 755 op/s 2024-09-19T07:22:55.996 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:55 smithi078 ceph-mon[34556]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-09-19T07:22:56.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:55 smithi029 ceph-mon[31255]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-09-19T07:22:56.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:55 smithi046 ceph-mon[34147]: pgmap v792: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-09-19T07:22:57.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 785.0 s, 805.6 tps, lat 123.730 ms stddev 74.417 2024-09-19T07:22:58.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:57 smithi029 ceph-mon[31255]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-09-19T07:22:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:57 smithi078 ceph-mon[34556]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-09-19T07:22:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:57 smithi046 ceph-mon[34147]: pgmap v793: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-09-19T07:23:00.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:22:59 smithi029 ceph-mon[31255]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 666 op/s 2024-09-19T07:23:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:22:59 smithi078 ceph-mon[34556]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 666 op/s 2024-09-19T07:23:00.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:22:59 smithi046 ceph-mon[34147]: pgmap v794: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.1 MiB/s wr, 666 op/s 2024-09-19T07:23:02.026 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:01 smithi046 ceph-mon[34147]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 694 op/s 2024-09-19T07:23:02.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:01 smithi029 ceph-mon[31255]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 694 op/s 2024-09-19T07:23:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:01 smithi078 ceph-mon[34556]: pgmap v795: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 694 op/s 2024-09-19T07:23:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 790.0 s, 723.2 tps, lat 138.072 ms stddev 161.503 2024-09-19T07:23:04.126 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:03 smithi029 ceph-mon[31255]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 704 op/s 2024-09-19T07:23:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:03 smithi078 ceph-mon[34556]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 704 op/s 2024-09-19T07:23:04.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:03 smithi046 ceph-mon[34147]: pgmap v796: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 704 op/s 2024-09-19T07:23:06.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:05 smithi029 ceph-mon[31255]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 665 op/s 2024-09-19T07:23:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:05 smithi078 ceph-mon[34556]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 665 op/s 2024-09-19T07:23:06.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:05 smithi046 ceph-mon[34147]: pgmap v797: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 665 op/s 2024-09-19T07:23:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 795.0 s, 743.6 tps, lat 134.212 ms stddev 82.741 2024-09-19T07:23:08.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:07 smithi029 ceph-mon[31255]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 730 op/s 2024-09-19T07:23:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:08.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:23:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:07 smithi078 ceph-mon[34556]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 730 op/s 2024-09-19T07:23:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:23:08.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:07 smithi046 ceph-mon[34147]: pgmap v798: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 730 op/s 2024-09-19T07:23:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:23:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:09 smithi029 ceph-mon[31255]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 MiB/s wr, 666 op/s 2024-09-19T07:23:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:09 smithi078 ceph-mon[34556]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 MiB/s wr, 666 op/s 2024-09-19T07:23:10.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:09 smithi046 ceph-mon[34147]: pgmap v799: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 MiB/s wr, 666 op/s 2024-09-19T07:23:12.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:11 smithi029 ceph-mon[31255]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.4 MiB/s wr, 716 op/s 2024-09-19T07:23:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:11 smithi078 ceph-mon[34556]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.4 MiB/s wr, 716 op/s 2024-09-19T07:23:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:11 smithi046 ceph-mon[34147]: pgmap v800: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.4 MiB/s wr, 716 op/s 2024-09-19T07:23:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 800.0 s, 734.2 tps, lat 135.398 ms stddev 50.090 2024-09-19T07:23:14.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:13 smithi029 ceph-mon[31255]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 735 op/s 2024-09-19T07:23:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:13 smithi078 ceph-mon[34556]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 735 op/s 2024-09-19T07:23:14.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:13 smithi046 ceph-mon[34147]: pgmap v801: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.5 MiB/s wr, 735 op/s 2024-09-19T07:23:16.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:15 smithi029 ceph-mon[31255]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 679 op/s 2024-09-19T07:23:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:15 smithi078 ceph-mon[34556]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 679 op/s 2024-09-19T07:23:16.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:15 smithi046 ceph-mon[34147]: pgmap v802: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.0 MiB/s wr, 679 op/s 2024-09-19T07:23:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 805.0 s, 627.6 tps, lat 160.765 ms stddev 125.922 2024-09-19T07:23:18.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:17 smithi029 ceph-mon[31255]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 724 op/s 2024-09-19T07:23:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:17 smithi078 ceph-mon[34556]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 724 op/s 2024-09-19T07:23:18.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:17 smithi046 ceph-mon[34147]: pgmap v803: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 724 op/s 2024-09-19T07:23:20.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:19 smithi029 ceph-mon[31255]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.9 MiB/s wr, 672 op/s 2024-09-19T07:23:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:19 smithi078 ceph-mon[34556]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.9 MiB/s wr, 672 op/s 2024-09-19T07:23:20.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:19 smithi046 ceph-mon[34147]: pgmap v804: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.9 MiB/s wr, 672 op/s 2024-09-19T07:23:22.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:21 smithi029 ceph-mon[31255]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 716 op/s 2024-09-19T07:23:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:21 smithi078 ceph-mon[34556]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 716 op/s 2024-09-19T07:23:22.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:21 smithi046 ceph-mon[34147]: pgmap v805: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 716 op/s 2024-09-19T07:23:22.298 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 810.0 s, 645.9 tps, lat 153.610 ms stddev 121.368 2024-09-19T07:23:24.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:23 smithi029 ceph-mon[31255]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 704 op/s 2024-09-19T07:23:24.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:23 smithi078 ceph-mon[34556]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 704 op/s 2024-09-19T07:23:24.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:23 smithi046 ceph-mon[34147]: pgmap v806: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 704 op/s 2024-09-19T07:23:26.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:25 smithi029 ceph-mon[31255]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 638 op/s 2024-09-19T07:23:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:25 smithi078 ceph-mon[34556]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 638 op/s 2024-09-19T07:23:26.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:25 smithi046 ceph-mon[34147]: pgmap v807: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.0 MiB/s wr, 638 op/s 2024-09-19T07:23:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 815.0 s, 827.0 tps, lat 121.988 ms stddev 75.896 2024-09-19T07:23:28.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:27 smithi029 ceph-mon[31255]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.3 MiB/s wr, 683 op/s 2024-09-19T07:23:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:27 smithi078 ceph-mon[34556]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.3 MiB/s wr, 683 op/s 2024-09-19T07:23:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:27 smithi046 ceph-mon[34147]: pgmap v808: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.3 MiB/s wr, 683 op/s 2024-09-19T07:23:30.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:29 smithi029 ceph-mon[31255]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 599 op/s 2024-09-19T07:23:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:29 smithi078 ceph-mon[34556]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 599 op/s 2024-09-19T07:23:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:29 smithi046 ceph-mon[34147]: pgmap v809: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.6 MiB/s wr, 599 op/s 2024-09-19T07:23:32.129 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:31 smithi029 ceph-mon[31255]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.3 MiB/s wr, 675 op/s 2024-09-19T07:23:32.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:31 smithi078 ceph-mon[34556]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.3 MiB/s wr, 675 op/s 2024-09-19T07:23:32.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:31 smithi046 ceph-mon[34147]: pgmap v810: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.3 MiB/s wr, 675 op/s 2024-09-19T07:23:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 820.0 s, 771.4 tps, lat 130.058 ms stddev 50.147 2024-09-19T07:23:34.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:33 smithi029 ceph-mon[31255]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.2 MiB/s wr, 709 op/s 2024-09-19T07:23:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:33 smithi078 ceph-mon[34556]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.2 MiB/s wr, 709 op/s 2024-09-19T07:23:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:33 smithi046 ceph-mon[34147]: pgmap v811: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.2 MiB/s wr, 709 op/s 2024-09-19T07:23:36.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:35 smithi029 ceph-mon[31255]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 651 op/s 2024-09-19T07:23:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:35 smithi078 ceph-mon[34556]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 651 op/s 2024-09-19T07:23:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:35 smithi046 ceph-mon[34147]: pgmap v812: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 651 op/s 2024-09-19T07:23:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 825.0 s, 666.8 tps, lat 149.383 ms stddev 89.510 2024-09-19T07:23:38.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:37 smithi029 ceph-mon[31255]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 726 op/s 2024-09-19T07:23:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:37 smithi078 ceph-mon[34556]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 726 op/s 2024-09-19T07:23:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:37 smithi046 ceph-mon[34147]: pgmap v813: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.4 MiB/s wr, 726 op/s 2024-09-19T07:23:40.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:39 smithi029 ceph-mon[31255]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 666 op/s 2024-09-19T07:23:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:39 smithi078 ceph-mon[34556]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 666 op/s 2024-09-19T07:23:40.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:39 smithi046 ceph-mon[34147]: pgmap v814: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 666 op/s 2024-09-19T07:23:42.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:41 smithi029 ceph-mon[31255]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 716 op/s 2024-09-19T07:23:42.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:41 smithi078 ceph-mon[34556]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 716 op/s 2024-09-19T07:23:42.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:41 smithi046 ceph-mon[34147]: pgmap v815: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.3 MiB/s wr, 716 op/s 2024-09-19T07:23:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 830.0 s, 737.0 tps, lat 135.820 ms stddev 59.290 2024-09-19T07:23:44.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:43 smithi029 ceph-mon[31255]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 721 op/s 2024-09-19T07:23:44.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:43 smithi078 ceph-mon[34556]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 721 op/s 2024-09-19T07:23:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:43 smithi046 ceph-mon[34147]: pgmap v816: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.2 MiB/s wr, 721 op/s 2024-09-19T07:23:46.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:45 smithi029 ceph-mon[31255]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 673 op/s 2024-09-19T07:23:46.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:45 smithi078 ceph-mon[34556]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 673 op/s 2024-09-19T07:23:46.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:45 smithi046 ceph-mon[34147]: pgmap v817: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 673 op/s 2024-09-19T07:23:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 835.0 s, 763.8 tps, lat 130.372 ms stddev 70.822 2024-09-19T07:23:48.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:47 smithi029 ceph-mon[31255]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 721 op/s 2024-09-19T07:23:48.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:47 smithi078 ceph-mon[34556]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 721 op/s 2024-09-19T07:23:48.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:47 smithi046 ceph-mon[34147]: pgmap v818: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 721 op/s 2024-09-19T07:23:50.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:49 smithi029 ceph-mon[31255]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.6 MiB/s wr, 648 op/s 2024-09-19T07:23:50.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:49 smithi078 ceph-mon[34556]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.6 MiB/s wr, 648 op/s 2024-09-19T07:23:50.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:49 smithi046 ceph-mon[34147]: pgmap v819: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.6 MiB/s wr, 648 op/s 2024-09-19T07:23:52.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:51 smithi029 ceph-mon[31255]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.6 MiB/s wr, 753 op/s 2024-09-19T07:23:52.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:51 smithi078 ceph-mon[34556]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.6 MiB/s wr, 753 op/s 2024-09-19T07:23:52.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:51 smithi046 ceph-mon[34147]: pgmap v820: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 6.6 MiB/s wr, 753 op/s 2024-09-19T07:23:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 840.0 s, 772.0 tps, lat 130.145 ms stddev 60.697 2024-09-19T07:23:54.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:53 smithi029 ceph-mon[31255]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 775 op/s 2024-09-19T07:23:54.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:53 smithi078 ceph-mon[34556]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 775 op/s 2024-09-19T07:23:54.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:53 smithi046 ceph-mon[34147]: pgmap v821: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 775 op/s 2024-09-19T07:23:56.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:55 smithi029 ceph-mon[31255]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 685 op/s 2024-09-19T07:23:56.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:55 smithi078 ceph-mon[34556]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 685 op/s 2024-09-19T07:23:56.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:55 smithi046 ceph-mon[34147]: pgmap v822: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 685 op/s 2024-09-19T07:23:57.297 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 845.0 s, 730.2 tps, lat 136.659 ms stddev 67.828 2024-09-19T07:23:58.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:57 smithi029 ceph-mon[31255]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 745 op/s 2024-09-19T07:23:58.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:57 smithi078 ceph-mon[34556]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 745 op/s 2024-09-19T07:23:58.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:57 smithi046 ceph-mon[34147]: pgmap v823: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 745 op/s 2024-09-19T07:24:00.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:23:59 smithi029 ceph-mon[31255]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 679 op/s 2024-09-19T07:24:00.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:23:59 smithi078 ceph-mon[34556]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 679 op/s 2024-09-19T07:24:00.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:23:59 smithi046 ceph-mon[34147]: pgmap v824: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.9 MiB/s wr, 679 op/s 2024-09-19T07:24:02.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:01 smithi029 ceph-mon[31255]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.7 MiB/s wr, 759 op/s 2024-09-19T07:24:02.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:01 smithi078 ceph-mon[34556]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.7 MiB/s wr, 759 op/s 2024-09-19T07:24:02.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:01 smithi046 ceph-mon[34147]: pgmap v825: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.7 MiB/s wr, 759 op/s 2024-09-19T07:24:02.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 850.0 s, 710.2 tps, lat 141.021 ms stddev 67.893 2024-09-19T07:24:04.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:03 smithi029 ceph-mon[31255]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 725 op/s 2024-09-19T07:24:04.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:03 smithi078 ceph-mon[34556]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 725 op/s 2024-09-19T07:24:04.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:03 smithi046 ceph-mon[34147]: pgmap v826: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 725 op/s 2024-09-19T07:24:06.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:05 smithi078 ceph-mon[34556]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 645 op/s 2024-09-19T07:24:06.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:05 smithi046 ceph-mon[34147]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 645 op/s 2024-09-19T07:24:06.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:05 smithi029 ceph-mon[31255]: pgmap v827: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 645 op/s 2024-09-19T07:24:07.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 855.0 s, 768.0 tps, lat 130.353 ms stddev 69.961 2024-09-19T07:24:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:07 smithi078 ceph-mon[34556]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 724 op/s 2024-09-19T07:24:08.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:07 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:08.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:07 smithi046 ceph-mon[34147]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 724 op/s 2024-09-19T07:24:08.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:07 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:08.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:07 smithi029 ceph-mon[31255]: pgmap v828: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.8 MiB/s wr, 724 op/s 2024-09-19T07:24:08.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:07 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:09.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:09.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:09.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:08 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:24:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:09.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:08 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:24:09.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:09.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:09.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:08 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:24:10.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:09 smithi078 ceph-mon[34556]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.2 MiB/s wr, 644 op/s 2024-09-19T07:24:10.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:09 smithi046 ceph-mon[34147]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.2 MiB/s wr, 644 op/s 2024-09-19T07:24:10.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:09 smithi029 ceph-mon[31255]: pgmap v829: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.2 MiB/s wr, 644 op/s 2024-09-19T07:24:12.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:11 smithi078 ceph-mon[34556]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 755 op/s 2024-09-19T07:24:12.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:11 smithi046 ceph-mon[34147]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 755 op/s 2024-09-19T07:24:12.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 860.0 s, 728.4 tps, lat 135.949 ms stddev 107.034 2024-09-19T07:24:12.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:11 smithi029 ceph-mon[31255]: pgmap v830: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.8 MiB/s wr, 755 op/s 2024-09-19T07:24:14.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:13 smithi078 ceph-mon[34556]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.8 MiB/s wr, 787 op/s 2024-09-19T07:24:14.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:13 smithi046 ceph-mon[34147]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.8 MiB/s wr, 787 op/s 2024-09-19T07:24:14.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:13 smithi029 ceph-mon[31255]: pgmap v831: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.8 MiB/s wr, 787 op/s 2024-09-19T07:24:16.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:15 smithi078 ceph-mon[34556]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 739 op/s 2024-09-19T07:24:16.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:15 smithi046 ceph-mon[34147]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 739 op/s 2024-09-19T07:24:16.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:15 smithi029 ceph-mon[31255]: pgmap v832: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 739 op/s 2024-09-19T07:24:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 865.0 s, 798.8 tps, lat 125.611 ms stddev 110.464 2024-09-19T07:24:18.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:17 smithi078 ceph-mon[34556]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-19T07:24:18.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:17 smithi046 ceph-mon[34147]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-19T07:24:18.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:17 smithi029 ceph-mon[31255]: pgmap v833: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 11 MiB/s wr, 805 op/s 2024-09-19T07:24:20.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:19 smithi078 ceph-mon[34556]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-09-19T07:24:20.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:19 smithi046 ceph-mon[34147]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-09-19T07:24:20.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:19 smithi029 ceph-mon[31255]: pgmap v834: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-09-19T07:24:22.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:21 smithi078 ceph-mon[34556]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 810 op/s 2024-09-19T07:24:22.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:21 smithi046 ceph-mon[34147]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 810 op/s 2024-09-19T07:24:22.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 870.0 s, 910.5 tps, lat 110.995 ms stddev 66.915 2024-09-19T07:24:22.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:21 smithi029 ceph-mon[31255]: pgmap v835: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 13 MiB/s wr, 810 op/s 2024-09-19T07:24:24.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:23 smithi078 ceph-mon[34556]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 13 MiB/s wr, 808 op/s 2024-09-19T07:24:24.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:23 smithi046 ceph-mon[34147]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 13 MiB/s wr, 808 op/s 2024-09-19T07:24:24.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:23 smithi029 ceph-mon[31255]: pgmap v836: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 13 MiB/s wr, 808 op/s 2024-09-19T07:24:26.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:25 smithi078 ceph-mon[34556]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 713 op/s 2024-09-19T07:24:26.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:25 smithi046 ceph-mon[34147]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 713 op/s 2024-09-19T07:24:26.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:25 smithi029 ceph-mon[31255]: pgmap v837: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 713 op/s 2024-09-19T07:24:27.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 875.0 s, 840.1 tps, lat 118.216 ms stddev 89.645 2024-09-19T07:24:28.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:27 smithi078 ceph-mon[34556]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 763 op/s 2024-09-19T07:24:28.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:27 smithi046 ceph-mon[34147]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 763 op/s 2024-09-19T07:24:28.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:27 smithi029 ceph-mon[31255]: pgmap v838: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 763 op/s 2024-09-19T07:24:30.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:29 smithi078 ceph-mon[34556]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-09-19T07:24:30.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:29 smithi046 ceph-mon[34147]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-09-19T07:24:30.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:29 smithi029 ceph-mon[31255]: pgmap v839: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-09-19T07:24:32.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:31 smithi078 ceph-mon[34556]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 12 MiB/s wr, 804 op/s 2024-09-19T07:24:32.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:31 smithi046 ceph-mon[34147]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 12 MiB/s wr, 804 op/s 2024-09-19T07:24:32.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 880.0 s, 796.8 tps, lat 125.761 ms stddev 88.945 2024-09-19T07:24:32.376 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:31 smithi029 ceph-mon[31255]: pgmap v840: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 12 MiB/s wr, 804 op/s 2024-09-19T07:24:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:33 smithi078 ceph-mon[34556]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 816 op/s 2024-09-19T07:24:34.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:33 smithi046 ceph-mon[34147]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 816 op/s 2024-09-19T07:24:34.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:33 smithi029 ceph-mon[31255]: pgmap v841: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 12 MiB/s wr, 816 op/s 2024-09-19T07:24:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:35 smithi046 ceph-mon[34147]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-09-19T07:24:36.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:35 smithi029 ceph-mon[31255]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-09-19T07:24:36.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:35 smithi078 ceph-mon[34556]: pgmap v842: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 728 op/s 2024-09-19T07:24:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 885.0 s, 806.0 tps, lat 123.961 ms stddev 98.099 2024-09-19T07:24:38.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:37 smithi046 ceph-mon[34147]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 790 op/s 2024-09-19T07:24:38.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:37 smithi029 ceph-mon[31255]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 790 op/s 2024-09-19T07:24:38.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:37 smithi078 ceph-mon[34556]: pgmap v843: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 11 MiB/s wr, 790 op/s 2024-09-19T07:24:40.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:39 smithi046 ceph-mon[34147]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-19T07:24:40.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:39 smithi029 ceph-mon[31255]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-19T07:24:40.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:39 smithi078 ceph-mon[34556]: pgmap v844: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 741 op/s 2024-09-19T07:24:42.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:41 smithi046 ceph-mon[34147]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-19T07:24:42.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 890.0 s, 800.2 tps, lat 124.547 ms stddev 123.143 2024-09-19T07:24:42.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:41 smithi029 ceph-mon[31255]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-19T07:24:42.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:41 smithi078 ceph-mon[34556]: pgmap v845: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-19T07:24:44.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:43 smithi046 ceph-mon[34147]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-19T07:24:44.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:43 smithi029 ceph-mon[31255]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-19T07:24:44.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:43 smithi078 ceph-mon[34556]: pgmap v846: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 11 MiB/s wr, 801 op/s 2024-09-19T07:24:46.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:45 smithi029 ceph-mon[31255]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-09-19T07:24:46.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:45 smithi078 ceph-mon[34556]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-09-19T07:24:46.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:45 smithi046 ceph-mon[34147]: pgmap v847: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 712 op/s 2024-09-19T07:24:47.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 895.0 s, 769.4 tps, lat 130.979 ms stddev 99.905 2024-09-19T07:24:48.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:47 smithi029 ceph-mon[31255]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 9.6 MiB/s wr, 737 op/s 2024-09-19T07:24:48.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:47 smithi078 ceph-mon[34556]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 9.6 MiB/s wr, 737 op/s 2024-09-19T07:24:48.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:47 smithi046 ceph-mon[34147]: pgmap v848: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 9.6 MiB/s wr, 737 op/s 2024-09-19T07:24:50.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:49 smithi029 ceph-mon[31255]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.7 MiB/s wr, 666 op/s 2024-09-19T07:24:50.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:49 smithi078 ceph-mon[34556]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.7 MiB/s wr, 666 op/s 2024-09-19T07:24:50.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:49 smithi046 ceph-mon[34147]: pgmap v849: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.7 MiB/s wr, 666 op/s 2024-09-19T07:24:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:progress: 900.0 s, 879.6 tps, lat 113.510 ms stddev 75.448 2024-09-19T07:24:52.375 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:52 smithi029 ceph-mon[31255]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 744 op/s 2024-09-19T07:24:52.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:52 smithi078 ceph-mon[34556]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 744 op/s 2024-09-19T07:24:52.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:52 smithi046 ceph-mon[34147]: pgmap v850: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.8 MiB/s wr, 744 op/s 2024-09-19T07:24:52.522 INFO:teuthology.orchestra.run.smithi029.stdout:transaction type: 2024-09-19T07:24:52.522 INFO:teuthology.orchestra.run.smithi029.stdout:scaling factor: 32 2024-09-19T07:24:52.522 INFO:teuthology.orchestra.run.smithi029.stdout:query mode: simple 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:number of clients: 100 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:number of threads: 4 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:duration: 900 s 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:number of transactions actually processed: 762134 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:latency average = 118.052 ms 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:latency stddev = 127.206 ms 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:tps = 846.602515 (including connections establishing) 2024-09-19T07:24:52.523 INFO:teuthology.orchestra.run.smithi029.stdout:tps = 846.613852 (excluding connections establishing) 2024-09-19T07:24:52.526 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-19T07:24:54.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:54 smithi029 ceph-mon[31255]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 777 op/s 2024-09-19T07:24:54.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:54 smithi078 ceph-mon[34556]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 777 op/s 2024-09-19T07:24:54.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:54 smithi046 ceph-mon[34147]: pgmap v851: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 777 op/s 2024-09-19T07:24:56.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:56 smithi029 ceph-mon[31255]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 9.8 MiB/s wr, 718 op/s 2024-09-19T07:24:56.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:56 smithi078 ceph-mon[34556]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 9.8 MiB/s wr, 718 op/s 2024-09-19T07:24:56.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:56 smithi046 ceph-mon[34147]: pgmap v852: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 9.8 MiB/s wr, 718 op/s 2024-09-19T07:24:58.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:24:58 smithi029 ceph-mon[31255]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.3 MiB/s wr, 773 op/s 2024-09-19T07:24:58.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:24:58 smithi078 ceph-mon[34556]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.3 MiB/s wr, 773 op/s 2024-09-19T07:24:58.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:24:58 smithi046 ceph-mon[34147]: pgmap v853: 129 pgs: 129 active+clean; 1.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 9.3 MiB/s wr, 773 op/s 2024-09-19T07:25:00.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:00 smithi029 ceph-mon[31255]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.9 MiB/s wr, 730 op/s 2024-09-19T07:25:00.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:00 smithi078 ceph-mon[34556]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.9 MiB/s wr, 730 op/s 2024-09-19T07:25:00.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:00 smithi046 ceph-mon[34147]: pgmap v854: 129 pgs: 129 active+clean; 1.5 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.9 MiB/s wr, 730 op/s 2024-09-19T07:25:02.277 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:02 smithi046 ceph-mon[34147]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 929 op/s 2024-09-19T07:25:02.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:02 smithi029 ceph-mon[31255]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 929 op/s 2024-09-19T07:25:02.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:02 smithi078 ceph-mon[34556]: pgmap v855: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 11 MiB/s wr, 929 op/s 2024-09-19T07:25:02.491 DEBUG:teuthology.orchestra.run.smithi029:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-19T07:25:02.793 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/: 2024-09-19T07:25:02.793 INFO:teuthology.orchestra.run.smithi029.stdout:total 2 2024-09-19T07:25:02.793 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039879 Sep 19 07:08 . 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1547039879 Sep 19 07:08 .. 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 data 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data: 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:total 46 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 . 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039879 Sep 19 07:08 .. 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 589731381 Sep 19 07:09 base 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 19 07:09 current_logfiles 2024-09-19T07:25:02.794 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 19 07:09 global 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1047 Sep 19 07:09 log 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_commit_ts 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_dynshmem 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 19 07:08 pg_hba.conf 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 19 07:08 pg_ident.conf 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:25 pg_logical 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 pg_multixact 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_notify 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_replslot 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_serial 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_snapshots 2024-09-19T07:25:02.795 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 19 07:25 pg_stat 2024-09-19T07:25:02.796 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:25 pg_stat_tmp 2024-09-19T07:25:02.796 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 19 07:24 pg_subtrans 2024-09-19T07:25:02.796 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_tblspc 2024-09-19T07:25:02.796 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 pg_twophase 2024-09-19T07:25:02.796 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:08 PG_VERSION 2024-09-19T07:25:02.796 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 956301312 Sep 19 07:25 pg_wal 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 pg_xact 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 19 07:08 postgresql.auto.conf 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 19 07:08 postgresql.conf 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 19 07:09 postmaster.opts 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base: 2024-09-19T07:25:02.797 INFO:teuthology.orchestra.run.smithi029.stdout:total 3 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 589731381 Sep 19 07:09 . 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 1 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 13493 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 573805103 Sep 19 07:15 13494 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 pgsql_tmp 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:total 7778 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 . 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 589731381 Sep 19 07:09 .. 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 112 2024-09-19T07:25:02.798 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 113 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 1247 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1247_fsm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1247_vm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 07:08 1249 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1249_fsm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1249_vm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 07:08 1255 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1255_fsm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1255_vm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 07:08 1259 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1259_fsm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1259_vm 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 07:08 13344 2024-09-19T07:25:02.799 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13344_fsm 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13344_vm 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13346 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13348 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13349_fsm 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349_vm 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13351 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13353 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13354_fsm 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354_vm 2024-09-19T07:25:02.800 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13356 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13358 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13359_fsm 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359_vm 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13361 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13363 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1417 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1418 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 174 2024-09-19T07:25:02.801 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 175 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2187 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2224 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2328 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2336 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2337 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2579 2024-09-19T07:25:02.802 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2600 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2600_fsm 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2600_vm 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2601_fsm 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601_vm 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2602 2024-09-19T07:25:02.803 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2602_fsm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2602_vm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2603 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2603_fsm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2603_vm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2604 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2605 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2605_fsm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2605_vm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2606_fsm 2024-09-19T07:25:02.804 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606_vm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2607 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2607_fsm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2607_vm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 07:08 2608 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2608_fsm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2608_vm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 07:08 2609 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2609_fsm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2609_vm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2610 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2610_fsm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2610_vm 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2611 2024-09-19T07:25:02.805 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2612_fsm 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612_vm 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2613 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2615_fsm 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615_vm 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2616 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2616_fsm 2024-09-19T07:25:02.806 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2616_vm 2024-09-19T07:25:02.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 07:08 2617 2024-09-19T07:25:02.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2617_fsm 2024-09-19T07:25:02.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2617_vm 2024-09-19T07:25:02.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 07:08 2618 2024-09-19T07:25:02.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2618_fsm 2024-09-19T07:25:02.807 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2618_vm 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 07:08 2619 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2619_fsm 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2619_vm 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2620 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2650 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2651 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2652 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2653 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2654 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2655 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2656 2024-09-19T07:25:02.808 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2657 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 07:08 2658 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 2659 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2660 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2661 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2662 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2663 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2664 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2665 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2666 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2667 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2668 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2669 2024-09-19T07:25:02.809 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2670 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 07:08 2673 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 07:08 2674 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 2675 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2678 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2679 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2680 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2681 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2682 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2683 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2684 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2685 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2686 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2687 2024-09-19T07:25:02.810 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2688 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2689 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 07:08 2690 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 07:08 2691 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2692 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2693 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2696 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2699 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2701 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2702 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2703 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2704 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2753 2024-09-19T07:25:02.811 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2753_fsm 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2753_vm 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2754 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2755 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2756 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2757 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2830 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2831 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2832 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2833 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2834 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2835 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2836 2024-09-19T07:25:02.812 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2837 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 07:08 2838 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2838_fsm 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2838_vm 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2839 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840_fsm 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2840_vm 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2841 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2995 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2996 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3079_fsm 2024-09-19T07:25:02.813 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079_vm 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3080 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3081 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3085 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3118 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3119 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:08 3164 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3256 2024-09-19T07:25:02.814 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3257 2024-09-19T07:25:02.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3258 2024-09-19T07:25:02.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3350 2024-09-19T07:25:02.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3351 2024-09-19T07:25:02.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3379 2024-09-19T07:25:02.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3380 2024-09-19T07:25:02.815 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3381 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3394 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3394_fsm 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3394_vm 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3395 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3429 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3430 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3431 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3433 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3439 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3440 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3455 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 07:08 3456 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3456_fsm 2024-09-19T07:25:02.816 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3456_vm 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3466 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3467 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3468 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3501 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3502 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3503 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3534 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3541_fsm 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541_vm 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3542 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3574 2024-09-19T07:25:02.817 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3575 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3576 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3596 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3597 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3598 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3599 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3600_fsm 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600_vm 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3601_fsm 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601_vm 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3602_fsm 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602_vm 2024-09-19T07:25:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603_fsm 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3603_vm 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3604 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3605 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3606 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3607 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3608 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 3609 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3712 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3764_fsm 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764_vm 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3766 2024-09-19T07:25:02.819 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3767 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3997 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4143 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4144 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4145 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4146 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4147 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4148 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4149 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4150 2024-09-19T07:25:02.820 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4151 2024-09-19T07:25:03.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4152 2024-09-19T07:25:03.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4153 2024-09-19T07:25:03.031 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4154 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4155 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4156 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4157 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4158 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4159 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4160 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4161 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4162 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4163 2024-09-19T07:25:03.032 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4164 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4165 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4166 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4167 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4168 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4169 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4170 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4171 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4172 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4173 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4174 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 5002 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 548 2024-09-19T07:25:03.033 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 549 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6102 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6104 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6106 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6110 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6111 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6112 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6113 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6117 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 826 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 827 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 828 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:08 pg_filenode.map 2024-09-19T07:25:03.034 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:08 PG_VERSION 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:total 7778 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 19 07:08 . 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 589731381 Sep 19 07:09 .. 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 112 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 113 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 1247 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1247_fsm 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1247_vm 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 07:08 1249 2024-09-19T07:25:03.035 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1249_fsm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1249_vm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 07:08 1255 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1255_fsm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1255_vm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 07:08 1259 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1259_fsm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1259_vm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 07:08 13344 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13344_fsm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13344_vm 2024-09-19T07:25:03.036 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13346 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13348 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13349_fsm 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349_vm 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13351 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13353 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13354_fsm 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13354_vm 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13356 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13358 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13359_fsm 2024-09-19T07:25:03.037 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359_vm 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13361 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13363 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1417 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1418 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 174 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 175 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2187 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2224 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2328 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2336 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2337 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2579 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2600 2024-09-19T07:25:03.038 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2600_fsm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2600_vm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2601_fsm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601_vm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2602 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2602_fsm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2602_vm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2603 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2603_fsm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2603_vm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2604 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2605 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2605_fsm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2605_vm 2024-09-19T07:25:03.039 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2606_fsm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2606_vm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2607 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2607_fsm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2607_vm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 07:08 2608 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2608_fsm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2608_vm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 07:08 2609 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2609_fsm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2609_vm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2610 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2610_fsm 2024-09-19T07:25:03.040 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2610_vm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2611 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2612_fsm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612_vm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2613 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2615_fsm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615_vm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2616 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2616_fsm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2616_vm 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 07:08 2617 2024-09-19T07:25:03.041 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2617_fsm 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2617_vm 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 07:08 2618 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2618_fsm 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2618_vm 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 19 07:08 2619 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2619_fsm 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2619_vm 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2620 2024-09-19T07:25:03.042 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2650 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2651 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2652 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2653 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2654 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2655 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2656 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2657 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 07:08 2658 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:08 2659 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2660 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2661 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2662 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2663 2024-09-19T07:25:03.043 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2664 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2665 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2666 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2667 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2668 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2669 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2670 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 07:08 2673 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 07:08 2674 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 2675 2024-09-19T07:25:03.044 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2678 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2679 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2680 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2681 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2682 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2683 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2684 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2685 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2686 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2687 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2688 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2689 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 07:08 2690 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 07:08 2691 2024-09-19T07:25:03.045 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2692 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2693 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2696 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2699 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2701 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2702 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2703 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2704 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2753 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2753_fsm 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2753_vm 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2754 2024-09-19T07:25:03.046 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2755 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2756 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2757 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2830 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2831 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2832 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2833 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2834 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2835 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2836 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2837 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 07:08 2838 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2838_fsm 2024-09-19T07:25:03.047 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2838_vm 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2839 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2840_fsm 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2840_vm 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2841 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2995 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2996 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3079_fsm 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3079_vm 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3080 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3081 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3085 2024-09-19T07:25:03.048 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3118 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3119 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:08 3164 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3256 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3257 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3258 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3350 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3351 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3379 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3380 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3381 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3394 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3394_fsm 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3394_vm 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3395 2024-09-19T07:25:03.049 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3429 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3430 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3431 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3433 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3439 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3440 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 3455 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 07:08 3456 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3456_fsm 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3456_vm 2024-09-19T07:25:03.050 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3466 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3467 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3468 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3501 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3502 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3503 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3534 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3541_fsm 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541_vm 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3542 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3574 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3575 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3576 2024-09-19T07:25:03.051 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3596 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3597 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3598 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3599 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3600_fsm 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600_vm 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3601_fsm 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601_vm 2024-09-19T07:25:03.052 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3602_fsm 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602_vm 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3603_fsm 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3603_vm 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3604 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3605 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3606 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3607 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3608 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 3609 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3712 2024-09-19T07:25:03.053 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3764_fsm 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3764_vm 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3766 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3767 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3997 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4143 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4144 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4145 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4146 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4147 2024-09-19T07:25:03.054 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4148 2024-09-19T07:25:03.055 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4149 2024-09-19T07:25:03.055 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4150 2024-09-19T07:25:03.055 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4151 2024-09-19T07:25:03.055 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4152 2024-09-19T07:25:03.055 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4153 2024-09-19T07:25:03.296 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4154 2024-09-19T07:25:03.296 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4155 2024-09-19T07:25:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4156 2024-09-19T07:25:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4157 2024-09-19T07:25:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4158 2024-09-19T07:25:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4159 2024-09-19T07:25:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4160 2024-09-19T07:25:03.297 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4161 2024-09-19T07:25:03.298 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4162 2024-09-19T07:25:03.298 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4163 2024-09-19T07:25:03.298 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4164 2024-09-19T07:25:03.298 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4165 2024-09-19T07:25:03.298 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4166 2024-09-19T07:25:03.299 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4167 2024-09-19T07:25:03.299 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4168 2024-09-19T07:25:03.299 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4169 2024-09-19T07:25:03.299 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4170 2024-09-19T07:25:03.299 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4171 2024-09-19T07:25:03.299 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4172 2024-09-19T07:25:03.300 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4173 2024-09-19T07:25:03.300 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4174 2024-09-19T07:25:03.300 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 5002 2024-09-19T07:25:03.300 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 548 2024-09-19T07:25:03.300 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 549 2024-09-19T07:25:03.300 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6102 2024-09-19T07:25:03.301 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6104 2024-09-19T07:25:03.301 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6106 2024-09-19T07:25:03.301 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6110 2024-09-19T07:25:03.301 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6111 2024-09-19T07:25:03.301 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6112 2024-09-19T07:25:03.301 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6113 2024-09-19T07:25:03.302 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6117 2024-09-19T07:25:03.302 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 826 2024-09-19T07:25:03.302 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 827 2024-09-19T07:25:03.302 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 828 2024-09-19T07:25:03.302 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:08 pg_filenode.map 2024-09-19T07:25:03.302 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:08 PG_VERSION 2024-09-19T07:25:03.303 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.303 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-19T07:25:03.303 INFO:teuthology.orchestra.run.smithi029.stdout:total 560359 2024-09-19T07:25:03.303 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 573805103 Sep 19 07:15 . 2024-09-19T07:25:03.303 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 589731381 Sep 19 07:09 .. 2024-09-19T07:25:03.304 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 112 2024-09-19T07:25:03.304 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 113 2024-09-19T07:25:03.304 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:10 1247 2024-09-19T07:25:03.304 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1247_fsm 2024-09-19T07:25:03.304 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 1247_vm 2024-09-19T07:25:03.304 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 19 07:10 1249 2024-09-19T07:25:03.305 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 1249_fsm 2024-09-19T07:25:03.305 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 1249_vm 2024-09-19T07:25:03.305 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 19 07:08 1255 2024-09-19T07:25:03.305 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 1255_fsm 2024-09-19T07:25:03.305 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1255_vm 2024-09-19T07:25:03.305 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 19 07:24 1259 2024-09-19T07:25:03.306 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 1259_fsm 2024-09-19T07:25:03.306 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 1259_vm 2024-09-19T07:25:03.306 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 19 07:08 13344 2024-09-19T07:25:03.306 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13344_fsm 2024-09-19T07:25:03.306 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13344_vm 2024-09-19T07:25:03.307 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13346 2024-09-19T07:25:03.307 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13348 2024-09-19T07:25:03.307 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13349 2024-09-19T07:25:03.307 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13349_fsm 2024-09-19T07:25:03.307 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13349_vm 2024-09-19T07:25:03.308 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 13351 2024-09-19T07:25:03.308 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13353 2024-09-19T07:25:03.308 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13354 2024-09-19T07:25:03.308 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 13354_fsm 2024-09-19T07:25:03.308 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 13354_vm 2024-09-19T07:25:03.308 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 13356 2024-09-19T07:25:03.309 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13358 2024-09-19T07:25:03.309 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359 2024-09-19T07:25:03.309 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 13359_fsm 2024-09-19T07:25:03.309 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13359_vm 2024-09-19T07:25:03.309 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 13361 2024-09-19T07:25:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 13363 2024-09-19T07:25:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 1417 2024-09-19T07:25:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 1418 2024-09-19T07:25:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 441810944 Sep 19 07:24 16396 2024-09-19T07:25:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 19 07:18 16396_fsm 2024-09-19T07:25:03.310 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:21 16396_vm 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4317184 Sep 19 07:24 16397 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:24 16397_fsm 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:24 16397_vm 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 5103616 Sep 19 07:24 16399 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:24 16399_fsm 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:24 16399_vm 2024-09-19T07:25:03.311 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:24 16400 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:20 16402 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 19 07:24 16404 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 42188800 Sep 19 07:24 16406 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:24 16406_fsm 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:22 16406_vm 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 174 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 175 2024-09-19T07:25:03.312 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2187 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2224 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2328 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2336 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2337 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2579 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2600 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2600_fsm 2024-09-19T07:25:03.313 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2600_vm 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2601_fsm 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2601_vm 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2602 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2602_fsm 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2602_vm 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:09 2603 2024-09-19T07:25:03.314 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2603_fsm 2024-09-19T07:25:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2603_vm 2024-09-19T07:25:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2604 2024-09-19T07:25:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2605 2024-09-19T07:25:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2605_fsm 2024-09-19T07:25:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2605_vm 2024-09-19T07:25:03.315 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:10 2606 2024-09-19T07:25:03.316 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2606_fsm 2024-09-19T07:25:03.316 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2606_vm 2024-09-19T07:25:03.316 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2607 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2607_fsm 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2607_vm 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 19 07:10 2608 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2608_fsm 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2608_vm 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 19 07:08 2609 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2609_fsm 2024-09-19T07:25:03.317 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2609_vm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:10 2610 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2610_fsm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2610_vm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2611 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2612_fsm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2612_vm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2613 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2615_fsm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2615_vm 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2616 2024-09-19T07:25:03.318 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2616_fsm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2616_vm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 19 07:08 2617 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2617_fsm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2617_vm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 19 07:08 2618 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2618_fsm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2618_vm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 19 07:24 2619 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:21 2619_fsm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2619_vm 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2620 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2650 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2651 2024-09-19T07:25:03.319 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2652 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 2653 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 2654 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:09 2655 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2656 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2657 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 19 07:10 2658 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 19 07:10 2659 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2660 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2661 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:10 2662 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:10 2663 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2664 2024-09-19T07:25:03.320 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2665 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2666 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2667 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2668 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2669 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2670 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 19 07:10 2673 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 19 07:10 2674 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 2675 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2678 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:10 2679 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2680 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2681 2024-09-19T07:25:03.321 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2682 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2683 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2684 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2685 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2686 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2687 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:08 2688 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 19 07:08 2689 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 19 07:09 2690 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 19 07:09 2691 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2692 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2693 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:23 2696 2024-09-19T07:25:03.322 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2699 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2701 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2702 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:10 2703 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:10 2704 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2753 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2753_fsm 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2753_vm 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2754 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2755 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2756 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 2757 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2830 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2831 2024-09-19T07:25:03.323 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2832 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2833 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2834 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2835 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 2836 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2837 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 19 07:09 2838 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2838_fsm 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2838_vm 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2839 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2840 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 2840_fsm 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2840_vm 2024-09-19T07:25:03.324 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2841 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2995 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2996 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3079 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3079_fsm 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3079_vm 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3080 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3081 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:09 3085 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3118 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3119 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 19 07:09 3164 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3256 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3257 2024-09-19T07:25:03.325 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3258 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3350 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3351 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3379 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3380 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3381 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3394 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3394_fsm 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3394_vm 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3395 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3429 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3430 2024-09-19T07:25:03.326 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3431 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3433 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3439 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3440 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 19 07:10 3455 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 19 07:08 3456 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3456_fsm 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3456_vm 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3466 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3467 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3468 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3501 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3502 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3503 2024-09-19T07:25:03.327 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3534 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3541 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3541_fsm 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3541_vm 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3542 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3574 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3575 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 3576 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3596 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3597 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3598 2024-09-19T07:25:03.328 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3599 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3600_fsm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3600_vm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3601 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3601_fsm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3601_vm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3602 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3602_fsm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3602_vm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3603 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:09 3603_fsm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3603_vm 2024-09-19T07:25:03.329 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3604 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3605 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3606 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3607 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3608 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 19 07:08 3609 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 3712 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3764 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 3764_fsm 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3764_vm 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3766 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 3767 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 3997 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4143 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4144 2024-09-19T07:25:03.330 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4145 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4146 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4147 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4148 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4149 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4150 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4151 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4152 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4153 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4154 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4155 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4156 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4157 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4158 2024-09-19T07:25:03.331 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4159 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4160 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4161 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4162 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4163 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4164 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4165 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4166 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 4167 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4168 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4169 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4170 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4171 2024-09-19T07:25:03.332 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4172 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4173 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 4174 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 5002 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 548 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 549 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6102 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6104 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 6106 2024-09-19T07:25:03.333 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 6110 2024-09-19T07:25:03.339 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 6111 2024-09-19T07:25:03.339 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 6112 2024-09-19T07:25:03.340 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6113 2024-09-19T07:25:03.340 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6117 2024-09-19T07:25:03.340 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 826 2024-09-19T07:25:03.340 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 827 2024-09-19T07:25:03.340 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 828 2024-09-19T07:25:03.341 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:09 pg_filenode.map 2024-09-19T07:25:03.341 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 19 07:09 pg_internal.init 2024-09-19T07:25:03.341 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 19 07:09 PG_VERSION 2024-09-19T07:25:03.341 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.341 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-19T07:25:03.341 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.342 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:09 . 2024-09-19T07:25:03.342 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 589731381 Sep 19 07:09 .. 2024-09-19T07:25:03.342 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.342 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/global: 2024-09-19T07:25:03.342 INFO:teuthology.orchestra.run.smithi029.stdout:total 561 2024-09-19T07:25:03.342 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 19 07:09 . 2024-09-19T07:25:03.343 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.343 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1213 2024-09-19T07:25:03.343 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1213_fsm 2024-09-19T07:25:03.343 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1213_vm 2024-09-19T07:25:03.343 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1214 2024-09-19T07:25:03.343 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1214_fsm 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1214_vm 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 1232 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 1233 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1260 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1260_fsm 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1260_vm 2024-09-19T07:25:03.344 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1261 2024-09-19T07:25:03.345 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1261_fsm 2024-09-19T07:25:03.345 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1261_vm 2024-09-19T07:25:03.345 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 1262 2024-09-19T07:25:03.345 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 1262_fsm 2024-09-19T07:25:03.345 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 1262_vm 2024-09-19T07:25:03.346 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:09 2396 2024-09-19T07:25:03.346 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 19 07:08 2396_fsm 2024-09-19T07:25:03.346 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2396_vm 2024-09-19T07:25:03.346 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:09 2397 2024-09-19T07:25:03.346 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2671 2024-09-19T07:25:03.346 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2672 2024-09-19T07:25:03.347 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2676 2024-09-19T07:25:03.347 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2677 2024-09-19T07:25:03.347 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2694 2024-09-19T07:25:03.353 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2695 2024-09-19T07:25:03.354 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2697 2024-09-19T07:25:03.354 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 2698 2024-09-19T07:25:03.354 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2846 2024-09-19T07:25:03.354 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2847 2024-09-19T07:25:03.354 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2964 2024-09-19T07:25:03.354 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2965 2024-09-19T07:25:03.355 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 2966 2024-09-19T07:25:03.355 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 2967 2024-09-19T07:25:03.355 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 3592 2024-09-19T07:25:03.355 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 3593 2024-09-19T07:25:03.355 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4060 2024-09-19T07:25:03.356 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4061 2024-09-19T07:25:03.356 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4175 2024-09-19T07:25:03.356 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4176 2024-09-19T07:25:03.356 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4177 2024-09-19T07:25:03.356 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4178 2024-09-19T07:25:03.357 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4181 2024-09-19T07:25:03.357 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4182 2024-09-19T07:25:03.357 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4183 2024-09-19T07:25:03.357 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4184 2024-09-19T07:25:03.357 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 4185 2024-09-19T07:25:03.357 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 4186 2024-09-19T07:25:03.358 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6000 2024-09-19T07:25:03.358 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6001 2024-09-19T07:25:03.358 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6002 2024-09-19T07:25:03.358 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 6100 2024-09-19T07:25:03.358 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6114 2024-09-19T07:25:03.358 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 6115 2024-09-19T07:25:03.359 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:25 pg_control 2024-09-19T07:25:03.359 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 19 07:08 pg_filenode.map 2024-09-19T07:25:03.359 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 19 07:09 pg_internal.init 2024-09-19T07:25:03.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.359 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/log: 2024-09-19T07:25:03.359 INFO:teuthology.orchestra.run.smithi029.stdout:total 3 2024-09-19T07:25:03.360 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1047 Sep 19 07:09 . 2024-09-19T07:25:03.360 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.360 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 Sep 19 07:25 postgresql-Thu.log 2024-09-19T07:25:03.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.360 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-19T07:25:03.361 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.361 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.361 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.361 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.361 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-19T07:25:03.361 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.362 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.362 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.362 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.362 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-19T07:25:03.363 INFO:teuthology.orchestra.run.smithi029.stdout:total 3 2024-09-19T07:25:03.390 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:25 . 2024-09-19T07:25:03.390 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.390 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 mappings 2024-09-19T07:25:03.390 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:25 replorigin_checkpoint 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 snapshots 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:25 .. 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 19 07:25 .. 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.391 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:total 2 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 . 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 members 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 offsets 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:total 9 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 . 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 .. 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 0000 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-19T07:25:03.392 INFO:teuthology.orchestra.run.smithi029.stdout:total 9 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:08 . 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 19 07:08 .. 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 19 07:14 0000 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.393 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:total 16 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 19 07:25 . 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.394 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 19 07:25 db_0.stat 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 19 07:25 db_13494.stat 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 19 07:25 global.stat 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:25 . 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:total 169 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 19 07:24 . 2024-09-19T07:25:03.395 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 19 07:24 000B 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.437 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:total 933890 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 956301312 Sep 19 07:25 . 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:25 000000010000000000000072 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:15 000000010000000000000073 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:14 000000010000000000000074 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:14 000000010000000000000075 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:15 000000010000000000000076 2024-09-19T07:25:03.438 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:16 000000010000000000000077 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:14 000000010000000000000078 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:16 000000010000000000000079 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:15 00000001000000000000007A 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:14 00000001000000000000007B 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:14 00000001000000000000007C 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000007D 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 00000001000000000000007E 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000007F 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000080 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 000000010000000000000081 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 000000010000000000000082 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:23 000000010000000000000083 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000084 2024-09-19T07:25:03.439 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000085 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:22 000000010000000000000086 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:21 000000010000000000000087 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 000000010000000000000088 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:21 000000010000000000000089 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000008A 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 00000001000000000000008B 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000008C 2024-09-19T07:25:03.440 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 00000001000000000000008D 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000008E 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 00000001000000000000008F 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:23 000000010000000000000090 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:21 000000010000000000000091 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000092 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000093 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000094 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000095 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000096 2024-09-19T07:25:03.443 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:22 000000010000000000000097 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:20 000000010000000000000098 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 000000010000000000000099 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000009A 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:19 00000001000000000000009B 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:21 00000001000000000000009C 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 00000001000000000000009D 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 00000001000000000000009E 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 00000001000000000000009F 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A0 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A1 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A2 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A3 2024-09-19T07:25:03.444 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A4 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A5 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A6 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A7 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A8 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000A9 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 19 07:24 0000000100000000000000AA 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 archive_status 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:total 1 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 19 07:08 . 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 956301312 Sep 19 07:25 .. 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:03.445 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-19T07:25:03.446 INFO:teuthology.orchestra.run.smithi029.stdout:total 193 2024-09-19T07:25:03.446 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:08 . 2024-09-19T07:25:03.446 INFO:teuthology.orchestra.run.smithi029.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1547039772 Sep 19 07:25 .. 2024-09-19T07:25:03.446 INFO:teuthology.orchestra.run.smithi029.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 19 07:24 0000 2024-09-19T07:25:03.447 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T07:25:03.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T07:25:04.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:04 smithi029 ceph-mon[31255]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 10 MiB/s wr, 978 op/s 2024-09-19T07:25:04.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:04 smithi078 ceph-mon[34556]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 10 MiB/s wr, 978 op/s 2024-09-19T07:25:04.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:04 smithi046 ceph-mon[34147]: pgmap v856: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 10 MiB/s wr, 978 op/s 2024-09-19T07:25:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 -- 172.21.15.29:0/950610226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc102630 msgr2=0x7fecdc104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:05.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 --2- 172.21.15.29:0/950610226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc102630 0x7fecdc104a20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feccc009900 tx=0x7feccc02a410 comp rx=0 tx=0).stop 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 -- 172.21.15.29:0/950610226 shutdown_connections 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 --2- 172.21.15.29:0/950610226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc107890 0x7fecdc109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 --2- 172.21.15.29:0/950610226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc104f60 0x7fecdc107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 --2- 172.21.15.29:0/950610226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc102630 0x7fecdc104a20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 -- 172.21.15.29:0/950610226 >> 172.21.15.29:0/950610226 conn(0x7fecdc0fc1f0 msgr2=0x7fecdc0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 -- 172.21.15.29:0/950610226 shutdown_connections 2024-09-19T07:25:05.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.746+0000 7fece16e6640 1 -- 172.21.15.29:0/950610226 wait complete. 2024-09-19T07:25:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 Processor -- start 2024-09-19T07:25:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 -- start start 2024-09-19T07:25:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc102630 0x7fecdc197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 0x7fecdc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc107890 0x7fecdc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:05.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc10d6d0 con 0x7fecdc104f60 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc10d550 con 0x7fecdc107890 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fece16e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fecdc10d850 con 0x7fecdc102630 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fecd3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 0x7fecdc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fecd3fff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 0x7fecdc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37202/0 (socket says 172.21.15.29:37202) 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fecd3fff640 1 -- 172.21.15.29:0/2884109264 learned_addr learned my addr 172.21.15.29:0/2884109264 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.747+0000 7fecdaffd640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc102630 0x7fecdc197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecdb7fe640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc107890 0x7fecdc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd3fff640 1 -- 172.21.15.29:0/2884109264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc102630 msgr2=0x7fecdc197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd3fff640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc102630 0x7fecdc197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd3fff640 1 -- 172.21.15.29:0/2884109264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc107890 msgr2=0x7fecdc19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd3fff640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc107890 0x7fecdc19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd3fff640 1 -- 172.21.15.29:0/2884109264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecdc19fa40 con 0x7fecdc104f60 2024-09-19T07:25:05.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecdaffd640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc102630 0x7fecdc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecdb7fe640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc107890 0x7fecdc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd3fff640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 0x7fecdc198360 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fecc400d770 tx=0x7fecc400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc4017070 con 0x7fecdc104f60 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fecc4009c30 con 0x7fecdc104f60 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecdc19fd30 con 0x7fecdc104f60 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.748+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc400f620 con 0x7fecdc104f60 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.749+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecdc1a0220 con 0x7fecdc104f60 2024-09-19T07:25:05.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.750+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecdc0fdce0 con 0x7fecdc104f60 2024-09-19T07:25:05.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.758+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fecc401a070 con 0x7fecdc104f60 2024-09-19T07:25:05.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.759+0000 7fecd8ff9640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fecc80a33a0 0x7fecc80a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.759+0000 7fecdaffd640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fecc80a33a0 0x7fecc80a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.759+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fecc40cf800 con 0x7fecdc104f60 2024-09-19T07:25:05.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.760+0000 7fecdaffd640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fecc80a33a0 0x7fecc80a5860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feccc0314e0 tx=0x7feccc032c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:05.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.764+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecc4009de0 con 0x7fecdc104f60 2024-09-19T07:25:05.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.948+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecdc062df0 con 0x7fecdc104f60 2024-09-19T07:25:05.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.950+0000 7fecd8ff9640 1 -- 172.21.15.29:0/2884109264 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24747 (secure 0 0 0) 0x7fecc409c130 con 0x7fecdc104f60 2024-09-19T07:25:05.951 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:05.951 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":92,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:08:15.648219+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:25:05.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fecc80a33a0 msgr2=0x7fecc80a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:05.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fecc80a33a0 0x7fecc80a5860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feccc0314e0 tx=0x7feccc032c60 comp rx=0 tx=0).stop 2024-09-19T07:25:05.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 msgr2=0x7fecdc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 0x7fecdc198360 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fecc400d770 tx=0x7fecc400dc30 comp rx=0 tx=0).stop 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 shutdown_connections 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecdc107890 0x7fecdc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fecdc104f60 0x7fecdc198360 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fecc80a33a0 0x7fecc80a5860 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 --2- 172.21.15.29:0/2884109264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecdc102630 0x7fecdc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 >> 172.21.15.29:0/2884109264 conn(0x7fecdc0fc1f0 msgr2=0x7fecdc103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 shutdown_connections 2024-09-19T07:25:05.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:05.952+0000 7fece16e6640 1 -- 172.21.15.29:0/2884109264 wait complete. 2024-09-19T07:25:05.968 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:01:36.264211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:06:21.388575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:06:23.758331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T07:06:30.244020+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T07:25:05.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 -- 172.21.15.29:0/193830889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 msgr2=0x7f7b1c100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 --2- 172.21.15.29:0/193830889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c100e30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009900 tx=0x7f7b1802a410 comp rx=0 tx=0).stop 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 -- 172.21.15.29:0/193830889 shutdown_connections 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 --2- 172.21.15.29:0/193830889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 0x7f7b1c108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 --2- 172.21.15.29:0/193830889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b1c101c20 0x7f7b1c1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 --2- 172.21.15.29:0/193830889 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c100e30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.075+0000 7f7b2401e640 1 -- 172.21.15.29:0/193830889 >> 172.21.15.29:0/193830889 conn(0x7f7b1c0fc190 msgr2=0x7f7b1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:06.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 -- 172.21.15.29:0/193830889 shutdown_connections 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 -- 172.21.15.29:0/193830889 wait complete. 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 Processor -- start 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 -- start start 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c10b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b1c101c20 0x7f7b1c1099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 0x7f7b1c109f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c10d670 con 0x7f7b1c100a30 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c10d4f0 con 0x7f7b1c1025e0 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b2401e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c10d7f0 con 0x7f7b1c101c20 2024-09-19T07:25:06.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b21dba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c10b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b21dba640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c10b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37216/0 (socket says 172.21.15.29:37216) 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b21dba640 1 -- 172.21.15.29:0/1622896798 learned_addr learned my addr 172.21.15.29:0/1622896798 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.076+0000 7f7b215b9640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b1c101c20 0x7f7b1c1099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b21dba640 1 -- 172.21.15.29:0/1622896798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b1c101c20 msgr2=0x7f7b1c1099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b21dba640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b1c101c20 0x7f7b1c1099f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b225bb640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 0x7f7b1c109f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b21dba640 1 -- 172.21.15.29:0/1622896798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 msgr2=0x7f7b1c109f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b21dba640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 0x7f7b1c109f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b21dba640 1 -- 172.21.15.29:0/1622896798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c10a7c0 con 0x7f7b1c100a30 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b225bb640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 0x7f7b1c109f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b21dba640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c10b3b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7b180314e0 tx=0x7f7b180042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1803f030 con 0x7f7b1c100a30 2024-09-19T07:25:06.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c1a1e20 con 0x7f7b1c100a30 2024-09-19T07:25:06.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7b180044d0 con 0x7f7b1c100a30 2024-09-19T07:25:06.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18035070 con 0x7f7b1c100a30 2024-09-19T07:25:06.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.077+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1a2230 con 0x7f7b1c100a30 2024-09-19T07:25:06.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.078+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c107e60 con 0x7f7b1c100a30 2024-09-19T07:25:06.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.079+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7b18042030 con 0x7f7b1c100a30 2024-09-19T07:25:06.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.080+0000 7f7b12ffd640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7b080a3250 0x7f7b080a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.080+0000 7f7b215b9640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7b080a3250 0x7f7b080a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.080+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f7b180f05c0 con 0x7f7b1c100a30 2024-09-19T07:25:06.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.081+0000 7f7b215b9640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7b080a3250 0x7f7b080a5710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c10b120 tx=0x7f7b0c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:06.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.083+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b180bcf50 con 0x7f7b1c100a30 2024-09-19T07:25:06.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.261+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7b1c02da30 con 0x7f7b1c100a30 2024-09-19T07:25:06.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.262+0000 7f7b12ffd640 1 -- 172.21.15.29:0/1622896798 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f7b180bc850 con 0x7f7b1c100a30 2024-09-19T07:25:06.262 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 1 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7b080a3250 msgr2=0x7f7b080a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7b080a3250 0x7f7b080a5710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c10b120 tx=0x7f7b0c00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 msgr2=0x7f7b1c10b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c10b3b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7b180314e0 tx=0x7f7b180042e0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 shutdown_connections 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7b1c1025e0 0x7f7b1c109f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f7b080a3250 0x7f7b080a5710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b1c101c20 0x7f7b1c1099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 --2- 172.21.15.29:0/1622896798 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b1c100a30 0x7f7b1c10b3b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 >> 172.21.15.29:0/1622896798 conn(0x7f7b1c0fc190 msgr2=0x7f7b1c105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:06.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 shutdown_connections 2024-09-19T07:25:06.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.264+0000 7f7b2401e640 1 -- 172.21.15.29:0/1622896798 wait complete. 2024-09-19T07:25:06.275 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:06 smithi029 ceph-mon[31255]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 8.9 MiB/s wr, 917 op/s 2024-09-19T07:25:06.275 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:06 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2884109264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:25:06.276 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.382+0000 7f4550f86640 1 -- 172.21.15.29:0/1328627836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c102d20 msgr2=0x7f454c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.382+0000 7f4550f86640 1 --2- 172.21.15.29:0/1328627836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c102d20 0x7f454c1031a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4534009900 tx=0x7f453402a3f0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.382+0000 7f4550f86640 1 -- 172.21.15.29:0/1328627836 shutdown_connections 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.382+0000 7f4550f86640 1 --2- 172.21.15.29:0/1328627836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c1036e0 0x7f454c109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.382+0000 7f4550f86640 1 --2- 172.21.15.29:0/1328627836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c102d20 0x7f454c1031a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.382+0000 7f4550f86640 1 --2- 172.21.15.29:0/1328627836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c101b30 0x7f454c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- 172.21.15.29:0/1328627836 >> 172.21.15.29:0/1328627836 conn(0x7f454c0fd2b0 msgr2=0x7f454c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- 172.21.15.29:0/1328627836 shutdown_connections 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- 172.21.15.29:0/1328627836 wait complete. 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 Processor -- start 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- start start 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c101b30 0x7f454c197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c102d20 0x7f454c198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 0x7f454c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f454c10d640 con 0x7f454c1036e0 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f454c10d4c0 con 0x7f454c102d20 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f4550f86640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f454c10d7c0 con 0x7f454c101b30 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f454ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 0x7f454c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f454ad9d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 0x7f454c19f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37240/0 (socket says 172.21.15.29:37240) 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.383+0000 7f454ad9d640 1 -- 172.21.15.29:0/3359604672 learned_addr learned my addr 172.21.15.29:0/3359604672 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454a59c640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c101b30 0x7f454c197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f4549d9b640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c102d20 0x7f454c198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454ad9d640 1 -- 172.21.15.29:0/3359604672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c101b30 msgr2=0x7f454c197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454ad9d640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c101b30 0x7f454c197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454ad9d640 1 -- 172.21.15.29:0/3359604672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c102d20 msgr2=0x7f454c198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454ad9d640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c102d20 0x7f454c198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454ad9d640 1 -- 172.21.15.29:0/3359604672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c19f900 con 0x7f454c1036e0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f4549d9b640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c102d20 0x7f454c198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f454ad9d640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 0x7f454c19f260 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f454400cce0 tx=0x7f454400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454400f450 con 0x7f454c1036e0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f454400faa0 con 0x7f454c1036e0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c19fbf0 con 0x7f454c1036e0 2024-09-19T07:25:06.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544018b70 con 0x7f454c1036e0 2024-09-19T07:25:06.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.384+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c1a00f0 con 0x7f454c1036e0 2024-09-19T07:25:06.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.385+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c108f40 con 0x7f454c1036e0 2024-09-19T07:25:06.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.387+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4544018d10 con 0x7f454c1036e0 2024-09-19T07:25:06.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.388+0000 7f45437fe640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f45380a3250 0x7f45380a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.388+0000 7f454a59c640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f45380a3250 0x7f45380a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.388+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f45440d0290 con 0x7f454c1036e0 2024-09-19T07:25:06.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.388+0000 7f454a59c640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f45380a3250 0x7f45380a5710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f453c0058c0 tx=0x7f453c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:06.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.391+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4544014030 con 0x7f454c1036e0 2024-09-19T07:25:06.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:06 smithi078 ceph-mon[34556]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 8.9 MiB/s wr, 917 op/s 2024-09-19T07:25:06.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:06 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2884109264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:25:06.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:06 smithi046 ceph-mon[34147]: pgmap v857: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 8.9 MiB/s wr, 917 op/s 2024-09-19T07:25:06.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:06 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2884109264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:25:06.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.572+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f454c02da10 con 0x7f454c1036e0 2024-09-19T07:25:06.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.572+0000 7f45437fe640 1 -- 172.21.15.29:0/3359604672 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f454409cc50 con 0x7f454c1036e0 2024-09-19T07:25:06.573 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f45380a3250 msgr2=0x7f45380a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f45380a3250 0x7f45380a5710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f453c0058c0 tx=0x7f453c005850 comp rx=0 tx=0).stop 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 msgr2=0x7f454c19f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 0x7f454c19f260 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f454400cce0 tx=0x7f454400a620 comp rx=0 tx=0).stop 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 shutdown_connections 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f454c1036e0 0x7f454c19f260 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f454c102d20 0x7f454c198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f45380a3250 0x7f45380a5710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 --2- 172.21.15.29:0/3359604672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f454c101b30 0x7f454c197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 >> 172.21.15.29:0/3359604672 conn(0x7f454c0fd2b0 msgr2=0x7f454c106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:06.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 shutdown_connections 2024-09-19T07:25:06.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.575+0000 7f4550f86640 1 -- 172.21.15.29:0/3359604672 wait complete. 2024-09-19T07:25:06.587 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T07:25:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3135979292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4100c90 msgr2=0x7ff5c4101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3135979292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4100c90 0x7ff5c4101110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009900 tx=0x7ff5ac02a410 comp rx=0 tx=0).stop 2024-09-19T07:25:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3135979292 shutdown_connections 2024-09-19T07:25:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3135979292 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c4101650 0x7ff5c4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3135979292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4100c90 0x7ff5c4101110 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3135979292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c4102040 0x7ff5c4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3135979292 >> 172.21.15.29:0/3135979292 conn(0x7ff5c40fb8f0 msgr2=0x7ff5c40fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3135979292 shutdown_connections 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.692+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3135979292 wait complete. 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 Processor -- start 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 -- start start 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c4100c90 0x7ff5c4197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c4101650 0x7ff5c4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 0x7ff5c419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410c550 con 0x7ff5c4102040 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410c3d0 con 0x7ff5c4101650 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5ca3d8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c410c6d0 con 0x7ff5c4100c90 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 0x7ff5c419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 0x7ff5c419f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37262/0 (socket says 172.21.15.29:37262) 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 -- 172.21.15.29:0/3806541392 learned_addr learned my addr 172.21.15.29:0/3806541392 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c3fff640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c4100c90 0x7ff5c4197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c37fe640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c4101650 0x7ff5c4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 -- 172.21.15.29:0/3806541392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c4100c90 msgr2=0x7ff5c4197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c4100c90 0x7ff5c4197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 -- 172.21.15.29:0/3806541392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c4101650 msgr2=0x7ff5c4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c4101650 0x7ff5c4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.693+0000 7ff5c8975640 1 -- 172.21.15.29:0/3806541392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c419fa00 con 0x7ff5c4102040 2024-09-19T07:25:06.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.694+0000 7ff5c8975640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 0x7ff5c419f390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00eaa0 tx=0x7ff5bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.694+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00cdb0 con 0x7ff5c4102040 2024-09-19T07:25:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.694+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c419fcf0 con 0x7ff5c4102040 2024-09-19T07:25:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.694+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff5bc005020 con 0x7ff5c4102040 2024-09-19T07:25:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.694+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0116d0 con 0x7ff5c4102040 2024-09-19T07:25:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.694+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c41a01c0 con 0x7ff5c4102040 2024-09-19T07:25:06.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.695+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c41a03f0 con 0x7ff5c4102040 2024-09-19T07:25:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.696+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff5bc0051d0 con 0x7ff5c4102040 2024-09-19T07:25:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.697+0000 7ff5c17fa640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5b00a3250 0x7ff5b00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.697+0000 7ff5c3fff640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5b00a3250 0x7ff5b00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.697+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff5bc0d0230 con 0x7ff5c4102040 2024-09-19T07:25:06.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.697+0000 7ff5c3fff640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5b00a3250 0x7ff5b00a5710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5c406a050 tx=0x7ff5b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:06.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.700+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff5bc016030 con 0x7ff5c4102040 2024-09-19T07:25:06.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.877+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff5c41a0660 con 0x7ff5c4102040 2024-09-19T07:25:06.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.878+0000 7ff5c17fa640 1 -- 172.21.15.29:0/3806541392 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7ff5bc09cbc0 con 0x7ff5c4102040 2024-09-19T07:25:06.878 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 64 2024-09-19T07:25:06.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5b00a3250 msgr2=0x7ff5b00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5b00a3250 0x7ff5b00a5710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5c406a050 tx=0x7ff5b400b390 comp rx=0 tx=0).stop 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 msgr2=0x7ff5c419f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 0x7ff5c419f390 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00eaa0 tx=0x7ff5bc00ef60 comp rx=0 tx=0).stop 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 shutdown_connections 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5c4102040 0x7ff5c419f390 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5c4101650 0x7ff5c4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff5b00a3250 0x7ff5b00a5710 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 --2- 172.21.15.29:0/3806541392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5c4100c90 0x7ff5c4197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 >> 172.21.15.29:0/3806541392 conn(0x7ff5c40fb8f0 msgr2=0x7ff5c40ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 shutdown_connections 2024-09-19T07:25:06.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.880+0000 7ff5ca3d8640 1 -- 172.21.15.29:0/3806541392 wait complete. 2024-09-19T07:25:06.892 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T07:25:07.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.998+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2565728162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 msgr2=0x7fb7ec109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2565728162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec109f70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009ca0 tx=0x7fb7e402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2565728162 shutdown_connections 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2565728162 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec109f70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2565728162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 0x7fb7ec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2565728162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7ec101b30 0x7fb7ec101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2565728162 >> 172.21.15.29:0/2565728162 conn(0x7fb7ec0fd270 msgr2=0x7fb7ec0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2565728162 shutdown_connections 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2565728162 wait complete. 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 Processor -- start 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- start start 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7ec101b30 0x7fb7ec197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 0x7fb7ec198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec19f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec10d660 con 0x7fb7ec1036e0 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec10d4e0 con 0x7fb7ec102d20 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:06.999+0000 7fb7f21c6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec10d7e0 con 0x7fb7ec101b30 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec19f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec19f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37272/0 (socket says 172.21.15.29:37272) 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 -- 172.21.15.29:0/2102920099 learned_addr learned my addr 172.21.15.29:0/2102920099 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7ec101b30 0x7fb7ec197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7eaffd640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 0x7fb7ec198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 -- 172.21.15.29:0/2102920099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7ec101b30 msgr2=0x7fb7ec197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7ec101b30 0x7fb7ec197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 -- 172.21.15.29:0/2102920099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 msgr2=0x7fb7ec198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 0x7fb7ec198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 -- 172.21.15.29:0/2102920099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec19f940 con 0x7fb7ec1036e0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7eaffd640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 0x7fb7ec198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7ebfff640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec19f2a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009dc0 tx=0x7fb7e4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4004040 con 0x7fb7ec1036e0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb7e4004690 con 0x7fb7ec1036e0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e402f4c0 con 0x7fb7ec1036e0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec19fbd0 con 0x7fb7ec1036e0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.000+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec1a0120 con 0x7fb7ec1036e0 2024-09-19T07:25:07.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.001+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ec108f20 con 0x7fb7ec1036e0 2024-09-19T07:25:07.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.002+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb7e4030650 con 0x7fb7ec1036e0 2024-09-19T07:25:07.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.003+0000 7fb7e8ff9640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb7d40a3250 0x7fb7d40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.003+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb7d40a3250 0x7fb7d40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.004+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fb7e40f17a0 con 0x7fb7ec1036e0 2024-09-19T07:25:07.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.004+0000 7fb7eb7fe640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb7d40a3250 0x7fb7d40a5710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc005fd0 tx=0x7fb7dc005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:07.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.007+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7e40393b0 con 0x7fb7ec1036e0 2024-09-19T07:25:07.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.183+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb7ec02da30 con 0x7fb7ec1036e0 2024-09-19T07:25:07.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.183+0000 7fb7e8ff9640 1 -- 172.21.15.29:0/2102920099 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7fb7e40be0d0 con 0x7fb7ec1036e0 2024-09-19T07:25:07.184 INFO:teuthology.orchestra.run.smithi029.stdout:pg_num: 32 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb7d40a3250 msgr2=0x7fb7d40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb7d40a3250 0x7fb7d40a5710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc005fd0 tx=0x7fb7dc005e40 comp rx=0 tx=0).stop 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 msgr2=0x7fb7ec19f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec19f2a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009dc0 tx=0x7fb7e4003ba0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 shutdown_connections 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7ec1036e0 0x7fb7ec19f2a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb7ec102d20 0x7fb7ec198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fb7d40a3250 0x7fb7d40a5710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 --2- 172.21.15.29:0/2102920099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7ec101b30 0x7fb7ec197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 >> 172.21.15.29:0/2102920099 conn(0x7fb7ec0fd270 msgr2=0x7fb7ec1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:07.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 shutdown_connections 2024-09-19T07:25:07.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.185+0000 7fb7f21c6640 1 -- 172.21.15.29:0/2102920099 wait complete. 2024-09-19T07:25:07.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:07 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1622896798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:07 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3359604672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.196 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:07 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3806541392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T07:25:07.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 -- 172.21.15.29:0/2955321788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 msgr2=0x7f9fd41049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 --2- 172.21.15.29:0/2955321788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd41049c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0009900 tx=0x7f9fd002a410 comp rx=0 tx=0).stop 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 -- 172.21.15.29:0/2955321788 shutdown_connections 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 --2- 172.21.15.29:0/2955321788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd4107830 0x7f9fd4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 --2- 172.21.15.29:0/2955321788 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fd4104f00 0x7f9fd41072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 --2- 172.21.15.29:0/2955321788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd41049c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 -- 172.21.15.29:0/2955321788 >> 172.21.15.29:0/2955321788 conn(0x7f9fd40fc190 msgr2=0x7f9fd40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 -- 172.21.15.29:0/2955321788 shutdown_connections 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.300+0000 7f9fdc198640 1 -- 172.21.15.29:0/2955321788 wait complete. 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 Processor -- start 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 -- start start 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fd4104f00 0x7f9fd4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd4107830 0x7f9fd419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410d6c0 con 0x7f9fd41025d0 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410d540 con 0x7f9fd4104f00 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fdc198640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd410d840 con 0x7f9fd4107830 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd4197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37296/0 (socket says 172.21.15.29:37296) 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 -- 172.21.15.29:0/1025771018 learned_addr learned my addr 172.21.15.29:0/1025771018 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fda735640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd4107830 0x7f9fd419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9733640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fd4104f00 0x7f9fd4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 -- 172.21.15.29:0/1025771018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd4107830 msgr2=0x7f9fd419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd4107830 0x7f9fd419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 -- 172.21.15.29:0/1025771018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fd4104f00 msgr2=0x7f9fd4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:07.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fd4104f00 0x7f9fd4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.301+0000 7f9fd9f34640 1 -- 172.21.15.29:0/1025771018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd419fa20 con 0x7f9fd41025d0 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.302+0000 7f9fd9f34640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd4197e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0005940 tx=0x7f9fd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.302+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd003f030 con 0x7f9fd41025d0 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.302+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9fd0003cb0 con 0x7f9fd41025d0 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.302+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd419fcb0 con 0x7f9fd41025d0 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.302+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0035070 con 0x7f9fd41025d0 2024-09-19T07:25:07.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.302+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd41a01a0 con 0x7f9fd41025d0 2024-09-19T07:25:07.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.303+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd40fdc80 con 0x7f9fd41025d0 2024-09-19T07:25:07.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.304+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9fd0042030 con 0x7f9fd41025d0 2024-09-19T07:25:07.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.305+0000 7f9fcaffd640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9fc00a3250 0x7f9fc00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:07.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.305+0000 7f9fd9733640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9fc00a3250 0x7f9fc00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:07.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.305+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f9fd00f0970 con 0x7f9fd41025d0 2024-09-19T07:25:07.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.305+0000 7f9fd9733640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9fc00a3250 0x7f9fc00a5710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4199310 tx=0x7f9fc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:07.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.308+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fd00bd2a0 con 0x7f9fd41025d0 2024-09-19T07:25:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:07 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1622896798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:07 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3359604672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:07 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3806541392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:07 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1622896798' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:07 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3359604672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:07 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3806541392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:25:07.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.533+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9fd4062e90 con 0x7f9fd41025d0 2024-09-19T07:25:07.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.541+0000 7f9fcaffd640 1 -- 172.21.15.29:0/1025771018 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742339 (secure 0 0 0) 0x7f9fd00bcba0 con 0x7f9fd41025d0 2024-09-19T07:25:07.551 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "epoch": 18, 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "active_gid": 14150, 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "active_name": "x", 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "active_addrs": { 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6800", 2024-09-19T07:25:07.552 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3056547780 2024-09-19T07:25:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v1", 2024-09-19T07:25:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:6801", 2024-09-19T07:25:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3056547780 2024-09-19T07:25:07.553 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.554 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:07.554 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.554 INFO:teuthology.orchestra.run.smithi029.stdout: "active_addr": "172.21.15.29:6801/3056547780", 2024-09-19T07:25:07.554 INFO:teuthology.orchestra.run.smithi029.stdout: "active_change": "2024-09-19T06:59:13.753573+0000", 2024-09-19T07:25:07.554 INFO:teuthology.orchestra.run.smithi029.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T07:25:07.554 INFO:teuthology.orchestra.run.smithi029.stdout: "available": true, 2024-09-19T07:25:07.555 INFO:teuthology.orchestra.run.smithi029.stdout: "standbys": [ 2024-09-19T07:25:07.555 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.555 INFO:teuthology.orchestra.run.smithi029.stdout: "gid": 24109, 2024-09-19T07:25:07.555 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "z", 2024-09-19T07:25:07.555 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_features": 4540701547738038271, 2024-09-19T07:25:07.556 INFO:teuthology.orchestra.run.smithi029.stdout: "available_modules": [ 2024-09-19T07:25:07.556 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.556 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "alerts", 2024-09-19T07:25:07.556 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.556 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.556 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.557 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:07.557 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:07.557 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.557 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.557 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.557 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.558 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.559 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.560 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.561 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.562 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.563 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.564 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_destination": { 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_destination", 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.565 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.566 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.566 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.568 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:25:07.568 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.568 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_from_name": { 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_from_name", 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "Ceph", 2024-09-19T07:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email From: name", 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.570 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_host": { 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_host", 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.571 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP server", 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_password": { 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_password", 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.572 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Password to authenticate with", 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.573 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_port": { 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_port", 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "465", 2024-09-19T07:25:07.574 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP port", 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_sender": { 2024-09-19T07:25:07.575 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_sender", 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.576 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_ssl": { 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_ssl", 2024-09-19T07:25:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_user": { 2024-09-19T07:25:07.578 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_user", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "User to authenticate as", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.579 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "balancer", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "active": { 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "active", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.580 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_time": { 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_time", 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.581 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0000", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_weekday": { 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_weekday", 2024-09-19T07:25:07.582 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:25:07.583 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_max_iterations": { 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "25", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "250", 2024-09-19T07:25:07.584 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_metrics": { 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_metrics", 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.585 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_step": { 2024-09-19T07:25:07.586 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_step", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.5", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0.001", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "0.999", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:25:07.587 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "end_time": { 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_time", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2359", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:25:07.588 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "end_weekday": { 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_weekday", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.589 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.590 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.591 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.592 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.593 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.594 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.595 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "min_score": { 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_score", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.596 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:25:07.597 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.597 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.597 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.597 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.597 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "upmap", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-compat", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "none", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "read", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap", 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap-read" 2024-09-19T07:25:07.598 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.599 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Balancer mode", 2024-09-19T07:25:07.599 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.599 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.599 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.599 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.599 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ids": { 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_ids", 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.600 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.601 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_deviation": { 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_deviation", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.602 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_optimizations": { 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.603 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm", 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_down_multiplier": { 2024-09-19T07:25:07.604 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_down_multiplier", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_refresh_rate": { 2024-09-19T07:25:07.605 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_refresh_rate", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "20", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.606 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_starting_port": { 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_starting_port", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4721", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.607 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_ptrace": { 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_ptrace", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:25:07.608 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_interval": { 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_interval", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.609 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.7", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.610 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_log_destination": { 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm_log_destination", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.611 INFO:teuthology.orchestra.run.smithi029.stdout: "file", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "file,syslog", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "syslog" 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "cgroups_split": { 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cgroups_split", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.612 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "config_checks_enabled": { 2024-09-19T07:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_checks_enabled", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "config_dashboard": { 2024-09-19T07:25:07.614 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_dashboard", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_alertmanager": { 2024-09-19T07:25:07.615 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_alertmanager", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:07.616 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_base": { 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_base", 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.617 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_elasticsearch": { 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.618 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "elasticsearch container image", 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.619 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_grafana": { 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_grafana", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:07.620 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_haproxy": { 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_haproxy", 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "HAproxy container image", 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_agent": { 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.622 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.623 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:25:07.623 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.623 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.623 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.623 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:25:07.623 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.624 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.624 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.624 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.624 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_collector": { 2024-09-19T07:25:07.624 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.625 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_query": { 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.626 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger query container image", 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.627 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_keepalived": { 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_keepalived", 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.628 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Keepalived container image", 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_loki": { 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_loki", 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:25:07.629 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Loki container image", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_node_exporter": { 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_node_exporter", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nvmeof": { 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nvmeof", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.631 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nvme-of container image", 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.632 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_prometheus": { 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_prometheus", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:07.633 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_promtail": { 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_promtail", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.634 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Promtail container image", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba": { 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.635 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_snmp_gateway": { 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.636 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.637 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "container_init": { 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_init", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:25:07.638 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "daemon_cache_timeout": { 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:25:07.639 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "900", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.640 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "default_registry": { 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_registry", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.641 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "device_cache_timeout": { 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_cache_timeout", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1800", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.642 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "device_enhanced_scan": { 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_enhanced_scan", 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.643 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "facts_cache_timeout": { 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "facts_cache_timeout", 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.644 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "grafana_dashboards_path": { 2024-09-19T07:25:07.645 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.646 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "host_check_interval": { 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "host_check_interval", 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.647 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "hw_monitoring": { 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hw_monitoring", 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.648 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "inventory_list_all": { 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "inventory_list_all", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.649 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.650 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.651 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "log_refresh_metadata": { 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_refresh_metadata", 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.652 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.653 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.653 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.653 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.653 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.653 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.654 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.655 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.656 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.657 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.658 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.659 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:25:07.660 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "*", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "max_count_per_host": { 2024-09-19T07:25:07.661 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_count_per_host", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.662 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd_draining_count": { 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_osd_draining_count", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.663 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "migration_current": { 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "migration_current", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "internal - do not modify", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.664 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "root", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm-package", 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: "root" 2024-09-19T07:25:07.665 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "oob_default_addr": { 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "oob_default_addr", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "169.254.1.1", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.666 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "prometheus_alerts_path": { 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.667 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_insecure": { 2024-09-19T07:25:07.668 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_insecure", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:25:07.669 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_password": { 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_password", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:25:07.670 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_url": { 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_url", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.671 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_username": { 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_username", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.672 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.673 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:25:07.673 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.673 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.673 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.673 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.674 INFO:teuthology.orchestra.run.smithi029.stdout: "secure_monitoring_stack": { 2024-09-19T07:25:07.674 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:25:07.674 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.674 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.674 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.674 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "service_discovery_port": { 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "service_discovery_port", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8765", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_config_file": { 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_config_file", 2024-09-19T07:25:07.676 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "use_agent": { 2024-09-19T07:25:07.677 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_agent", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.678 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "use_repo_digest": { 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_repo_digest", 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.679 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_failed_host_check": { 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.680 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_daemons": { 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.681 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.682 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_hosts": { 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.683 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crash", 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.684 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.685 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.686 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.687 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.688 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.689 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.690 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "retain_interval": { 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retain_interval", 2024-09-19T07:25:07.691 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "31536000", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.692 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_recent_interval": { 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_recent_interval", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1209600", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.693 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dashboard", 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:25:07.694 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:25:07.695 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.696 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.697 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.698 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.699 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.700 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:25:07.701 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.702 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:25:07.703 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:25:07.704 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.705 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.706 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.707 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.708 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.709 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.710 INFO:teuthology.orchestra.run.smithi029.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.711 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.712 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.713 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_URL": { 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.714 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.715 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.716 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.717 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.718 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.719 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.720 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.721 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.722 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.723 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.724 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.725 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.726 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.727 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.727 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:25:07.727 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:25:07.727 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.727 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.727 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.728 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.729 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.730 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.731 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.732 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.734 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.735 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "45", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.736 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.737 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.738 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:25:07.739 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:25:07.740 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:25:07.741 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.742 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.743 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "cross_origin_url": { 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cross_origin_url", 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.744 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "crt_file": { 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crt_file", 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.745 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "debug": { 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "debug", 2024-09-19T07:25:07.746 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "jwt_token_ttl": { 2024-09-19T07:25:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "jwt_token_ttl", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "28800", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.748 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.749 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.750 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.751 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.752 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.753 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.754 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "motd": { 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "motd", 2024-09-19T07:25:07.755 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "The message of the day", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:25:07.756 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:07.757 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:07.758 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:07.759 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.759 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.759 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.759 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8080", 2024-09-19T07:25:07.759 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.759 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.760 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl_server_port": { 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl_server_port", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.761 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8443", 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.762 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.763 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "redirect", 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect" 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.764 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.765 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "url_prefix": { 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url_prefix", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.766 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_monitoring": { 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_monitoring", 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.767 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "monitor device health metrics", 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.768 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.769 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.770 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.772 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.773 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.773 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.773 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.773 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.773 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.773 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.774 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "mark_out_threshold": { 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mark_out_threshold", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2419200", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:25:07.775 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": { 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_name", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "device_health_metrics", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:25:07.776 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "retention_period": { 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retention_period", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15552000", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:25:07.777 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_frequency": { 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_frequency", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.778 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "self_heal": { 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "self_heal", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.779 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.780 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_threshold": { 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_threshold", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7257600", 2024-09-19T07:25:07.781 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "diskprediction_local", 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.782 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.783 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.784 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.785 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.786 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.787 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.788 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "predict_interval": { 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predict_interval", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.789 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "predictor_model": { 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predictor_model", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "prophetstor", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.790 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.791 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "influx", 2024-09-19T07:25:07.792 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": false, 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "batch_size": { 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "batch_size", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5000", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.793 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: "database": { 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "database", 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.794 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "ceph", 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": { 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hostname", 2024-09-19T07:25:07.795 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:07.796 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "30", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "5", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.797 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.798 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.799 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: "password": { 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "password", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "port": { 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "port", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8086", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server port", 2024-09-19T07:25:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "false", 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "threads": { 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threads", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "32", 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "username": { 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "username", 2024-09-19T07:25:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: "verify_ssl": { 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "verify_ssl", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "true", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "insights", 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.813 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.814 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.815 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "iostat", 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.816 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.817 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.818 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.819 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.820 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.821 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "k8sevents", 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_event_retention_days": { 2024-09-19T07:25:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "config_check_secs": { 2024-09-19T07:25:07.823 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_check_secs", 2024-09-19T07:25:07.824 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.824 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.824 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.824 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.824 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "10", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.825 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.826 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.827 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.828 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.829 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.830 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "localpool", 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.831 INFO:teuthology.orchestra.run.smithi029.stdout: "failure_domain": { 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "failure_domain", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "host", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.832 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.833 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.834 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.835 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.836 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.837 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": { 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_size", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.838 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "num_rep": { 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "num_rep", 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.839 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": { 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_num", 2024-09-19T07:25:07.840 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "128", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "prefix": { 2024-09-19T07:25:07.841 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prefix", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "subtree": { 2024-09-19T07:25:07.842 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "subtree", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "rack", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.843 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mds_autoscaler", 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.844 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.845 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.846 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.847 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.849 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.850 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.851 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.852 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.853 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.853 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.853 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.853 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.853 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirroring", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.854 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.855 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.856 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.857 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.858 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.859 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "nfs", 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.860 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.861 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.862 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.863 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.864 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.865 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "fail_fs": { 2024-09-19T07:25:07.866 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "fail_fs", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.867 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.868 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.869 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.870 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.871 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.872 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator": { 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "rook", 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: "test_orchestrator" 2024-09-19T07:25:07.873 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Orchestrator backend", 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_perf_query", 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.874 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.875 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.876 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.877 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.878 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.879 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_support", 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.880 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.881 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.882 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.882 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.882 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.882 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.882 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.882 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.883 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.884 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.885 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.886 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_autoscaler", 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.887 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.888 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.889 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.890 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.891 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.892 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.893 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "threshold": { 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threshold", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.894 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1.0", 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "scaling threshold", 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.895 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "progress", 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_pg_recovery_event": { 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.896 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-19T07:25:07.897 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.899 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.900 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.901 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.902 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.903 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "max_completed_events": { 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_completed_events", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.904 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "50", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.905 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.906 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "cache": { 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cache", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.907 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "exclude_perf_counters": { 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "exclude_perf_counters", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.908 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.909 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.910 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.911 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.912 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.913 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.914 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools": { 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.915 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "300", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.916 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_interval": { 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_interval", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15.0", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.917 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.918 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.919 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "9283", 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "stale_cache_strategy": { 2024-09-19T07:25:07.920 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stale_cache_strategy", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "log", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.921 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "default", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "default", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "error" 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.922 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.923 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.924 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.925 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.926 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.926 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.926 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.926 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.926 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.927 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.928 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.929 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_snap_create": { 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "trash_purge_schedule": { 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "trash_purge_schedule", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.933 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "restful", 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_auth": { 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_auth", 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.934 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.935 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.936 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.937 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.938 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.939 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.940 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.941 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.942 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.943 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.944 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rgw", 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.945 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.946 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.947 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.948 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.949 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.950 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:25:07.951 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rook", 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.952 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.953 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.954 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.955 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.956 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.957 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_class": { 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "storage_class", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "local", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.958 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "selftest", 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.959 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.960 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.961 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.962 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.963 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.964 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "roption1": { 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption1", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.965 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "roption2": { 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption2", 2024-09-19T07:25:07.966 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "xyz", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption1": { 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption1", 2024-09-19T07:25:07.967 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.968 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption2": { 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption2", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.969 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption3": { 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption3", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.970 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption4": { 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption4", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.971 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption5": { 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption5", 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.972 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption6": { 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption6", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:07.973 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption7": { 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption7", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.974 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "42", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "testkey": { 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testkey", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.975 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "testlkey": { 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testlkey", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.976 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "testnewline": { 2024-09-19T07:25:07.977 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testnewline", 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.978 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.979 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.980 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snap_schedule", 2024-09-19T07:25:07.980 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.980 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.980 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.980 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_m_granularity": { 2024-09-19T07:25:07.981 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_m_granularity", 2024-09-19T07:25:07.981 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.981 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.981 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.981 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.981 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.982 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.982 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.982 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:25:07.982 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.982 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.983 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.983 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.983 INFO:teuthology.orchestra.run.smithi029.stdout: "dump_on_update": { 2024-09-19T07:25:07.983 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dump_on_update", 2024-09-19T07:25:07.983 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.983 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.984 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.984 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.984 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.984 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.984 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.985 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:25:07.985 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.985 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.985 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.985 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.985 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.986 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.987 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.988 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.989 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.990 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stats", 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:07.991 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.992 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.993 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.993 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.993 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.993 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.993 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.994 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.995 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:07.996 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:07.997 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:07.998 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:07.999 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "status", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.000 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.001 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.002 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.003 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telegraf", 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.005 INFO:teuthology.orchestra.run.smithi029.stdout: "address": { 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "address", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.006 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.007 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.008 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.009 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.009 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.009 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.009 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.009 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.010 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.010 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.010 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.010 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.010 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.010 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.011 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.011 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.011 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.011 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.011 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.012 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.012 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.012 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.012 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.012 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.012 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.013 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.014 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.015 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telemetry", 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_basic": { 2024-09-19T07:25:08.016 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_basic", 2024-09-19T07:25:08.017 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.017 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.017 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.017 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.017 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.017 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_crash": { 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_crash", 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.018 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_device": { 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_device", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.019 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_ident": { 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_ident", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.020 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.021 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_perf": { 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_perf", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.022 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "contact": { 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "contact", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.023 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "description": { 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "description", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.024 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "device_url": { 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_url", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.025 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.026 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "24", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "8", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.027 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "last_opt_revision": { 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "last_opt_revision", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.028 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard": { 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.029 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard_description": { 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard_description", 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.030 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.031 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.032 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.033 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.034 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.035 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.036 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "organization": { 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "organization", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "proxy": { 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "proxy", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.038 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "url": { 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.039 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "test_orchestrator", 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.040 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.041 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.042 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.043 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.044 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.045 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.046 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.047 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.048 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.049 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.050 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.051 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_clones": { 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_clones", 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.052 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4", 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.053 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "periodic_async_work": { 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "periodic_async_work", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Periodically check for async work", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.054 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_delay": { 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.055 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.056 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix", 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.057 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "discovery_interval": { 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "discovery_interval", 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "100", 2024-09-19T07:25:08.058 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.059 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.059 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.059 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.059 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.059 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.059 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.060 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.060 INFO:teuthology.orchestra.run.smithi029.stdout: "identifier": { 2024-09-19T07:25:08.060 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "identifier", 2024-09-19T07:25:08.060 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.060 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.060 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.061 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.062 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.062 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.062 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.062 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.062 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.062 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.063 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.063 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.063 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.063 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.063 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.063 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.064 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.065 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.066 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.067 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.068 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_host": { 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_host", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.069 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_port": { 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_port", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.070 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10051", 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_sender": { 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_sender", 2024-09-19T07:25:08.071 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.072 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "gid": 24116, 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "y", 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "mgr_features": 4540701547738038271, 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "available_modules": [ 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "alerts", 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.073 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.074 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.075 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.076 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.077 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.078 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_destination": { 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_destination", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.080 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_from_name": { 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_from_name", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.081 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "Ceph", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email From: name", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_host": { 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_host", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.082 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP server", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_password": { 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_password", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.083 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Password to authenticate with", 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.084 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_port": { 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_port", 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "465", 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.085 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP port", 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_sender": { 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_sender", 2024-09-19T07:25:08.086 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:25:08.087 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_ssl": { 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_ssl", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.088 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_user": { 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_user", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.089 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "User to authenticate as", 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "balancer", 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "active": { 2024-09-19T07:25:08.090 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "active", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.091 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_time": { 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_time", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0000", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.092 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_weekday": { 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_weekday", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.093 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_max_iterations": { 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "25", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "250", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.094 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_metrics": { 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_metrics", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:25:08.095 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_step": { 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_step", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.5", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0.001", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "0.999", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:25:08.096 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "end_time": { 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_time", 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.097 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2359", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "end_weekday": { 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_weekday", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.098 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.099 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.100 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.101 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.102 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.103 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.103 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.103 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.103 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.103 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.103 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.104 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.104 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.104 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.104 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.104 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.105 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.105 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.105 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.105 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.105 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.105 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.106 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.106 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.106 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.106 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.106 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.106 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.107 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.107 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.107 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.107 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.107 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.107 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "min_score": { 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_score", 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.108 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.109 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "upmap", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-compat", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "none", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "read", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap-read" 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Balancer mode", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.110 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ids": { 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_ids", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.111 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.112 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_deviation": { 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_deviation", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.113 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_optimizations": { 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.114 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm", 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_down_multiplier": { 2024-09-19T07:25:08.115 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_down_multiplier", 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.116 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_refresh_rate": { 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_refresh_rate", 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "20", 2024-09-19T07:25:08.117 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_starting_port": { 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_starting_port", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4721", 2024-09-19T07:25:08.118 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_ptrace": { 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_ptrace", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.119 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_interval": { 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_interval", 2024-09-19T07:25:08.120 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:25:08.121 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.7", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.122 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_log_destination": { 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm_log_destination", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "file", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "file,syslog", 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: "syslog" 2024-09-19T07:25:08.123 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "cgroups_split": { 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cgroups_split", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.124 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "config_checks_enabled": { 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_checks_enabled", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.125 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "config_dashboard": { 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_dashboard", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.126 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_alertmanager": { 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_alertmanager", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:25:08.127 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_base": { 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_base", 2024-09-19T07:25:08.128 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_elasticsearch": { 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:25:08.129 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "elasticsearch container image", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_grafana": { 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_grafana", 2024-09-19T07:25:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.131 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_haproxy": { 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_haproxy", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "HAproxy container image", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.132 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_agent": { 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.133 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_collector": { 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:25:08.134 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_query": { 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger query container image", 2024-09-19T07:25:08.135 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_keepalived": { 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_keepalived", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Keepalived container image", 2024-09-19T07:25:08.136 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_loki": { 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_loki", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Loki container image", 2024-09-19T07:25:08.137 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_node_exporter": { 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_node_exporter", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.138 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nvmeof": { 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nvmeof", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.139 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nvme-of container image", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_prometheus": { 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_prometheus", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.140 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_promtail": { 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_promtail", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.141 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Promtail container image", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba": { 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.142 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_snmp_gateway": { 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.143 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "container_init": { 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_init", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.144 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "daemon_cache_timeout": { 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.145 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.146 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "900", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "default_registry": { 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_registry", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.147 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io", 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "device_cache_timeout": { 2024-09-19T07:25:08.148 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_cache_timeout", 2024-09-19T07:25:08.149 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.149 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.149 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.149 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1800", 2024-09-19T07:25:08.149 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.149 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.150 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.150 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:25:08.150 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.150 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.150 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.150 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "device_enhanced_scan": { 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_enhanced_scan", 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.151 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "facts_cache_timeout": { 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "facts_cache_timeout", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.152 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "grafana_dashboards_path": { 2024-09-19T07:25:08.153 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.154 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "host_check_interval": { 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "host_check_interval", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.155 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "hw_monitoring": { 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hw_monitoring", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.156 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "inventory_list_all": { 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "inventory_list_all", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.157 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.158 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "log_refresh_metadata": { 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_refresh_metadata", 2024-09-19T07:25:08.159 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.160 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.161 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.162 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.163 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:25:08.164 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:25:08.165 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "*", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.166 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "max_count_per_host": { 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_count_per_host", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.167 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd_draining_count": { 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_osd_draining_count", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.168 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "migration_current": { 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "migration_current", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "internal - do not modify", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.169 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "root", 2024-09-19T07:25:08.170 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm-package", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "root" 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "oob_default_addr": { 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "oob_default_addr", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.171 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "169.254.1.1", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "prometheus_alerts_path": { 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.172 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_insecure": { 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_insecure", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.173 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_password": { 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_password", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.174 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_url": { 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_url", 2024-09-19T07:25:08.175 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_username": { 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_username", 2024-09-19T07:25:08.176 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "secure_monitoring_stack": { 2024-09-19T07:25:08.177 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "service_discovery_port": { 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "service_discovery_port", 2024-09-19T07:25:08.178 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8765", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_config_file": { 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_config_file", 2024-09-19T07:25:08.179 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.180 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "use_agent": { 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_agent", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.181 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "use_repo_digest": { 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_repo_digest", 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.182 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_failed_host_check": { 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.183 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_daemons": { 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.184 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_hosts": { 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:25:08.185 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.188 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.188 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.188 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.189 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crash", 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.190 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.191 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.192 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.193 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.194 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.195 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "retain_interval": { 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retain_interval", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "31536000", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.196 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_recent_interval": { 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_recent_interval", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1209600", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.197 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dashboard", 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.198 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:25:08.199 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:25:08.200 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:25:08.201 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:25:08.202 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:25:08.203 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.204 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.205 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.206 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.207 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.208 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.209 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.210 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.211 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.212 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:08.213 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.214 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_URL": { 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.215 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.216 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.217 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.218 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:25:08.219 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:25:08.220 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.221 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:25:08.222 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:25:08.223 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.224 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.225 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.226 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.227 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.228 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.229 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.230 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.231 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.232 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.233 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.234 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "45", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.235 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.236 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.237 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.238 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.239 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.240 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.241 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.242 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "cross_origin_url": { 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cross_origin_url", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.243 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "crt_file": { 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crt_file", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.244 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "debug": { 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "debug", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.245 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "jwt_token_ttl": { 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "jwt_token_ttl", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "28800", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.246 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.248 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.249 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.250 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.251 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.252 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "motd": { 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "motd", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.253 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "The message of the day", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.254 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.255 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.256 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8080", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.257 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl_server_port": { 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl_server_port", 2024-09-19T07:25:08.258 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8443", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.259 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "redirect", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect" 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.260 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.261 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "url_prefix": { 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url_prefix", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.262 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_monitoring": { 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_monitoring", 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.263 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "monitor device health metrics", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.264 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.265 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.266 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.267 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.268 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "mark_out_threshold": { 2024-09-19T07:25:08.269 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mark_out_threshold", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2419200", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.270 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": { 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_name", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "device_health_metrics", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.271 INFO:teuthology.orchestra.run.smithi029.stdout: "retention_period": { 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retention_period", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15552000", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.272 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_frequency": { 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_frequency", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.273 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "self_heal": { 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "self_heal", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.274 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.275 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_threshold": { 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_threshold", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7257600", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.276 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "diskprediction_local", 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.277 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.278 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.279 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.280 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.281 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "predict_interval": { 2024-09-19T07:25:08.282 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predict_interval", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "predictor_model": { 2024-09-19T07:25:08.283 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predictor_model", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "prophetstor", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.284 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.285 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "influx", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": false, 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "batch_size": { 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "batch_size", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5000", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.286 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "database": { 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "database", 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.287 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "ceph", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": { 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hostname", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.289 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "30", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "5", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.290 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.291 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.292 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.293 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "password": { 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "password", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:25:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "port": { 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "port", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8086", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.297 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server port", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "false", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.298 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "threads": { 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threads", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.299 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "32", 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "username": { 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "username", 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.300 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "verify_ssl": { 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "verify_ssl", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.301 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "true", 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.302 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "insights", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.303 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.304 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.305 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.306 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.307 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.308 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "iostat", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.309 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.310 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.311 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.312 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.313 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "k8sevents", 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.314 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_event_retention_days": { 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.315 INFO:teuthology.orchestra.run.smithi029.stdout: "config_check_secs": { 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_check_secs", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "10", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.316 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.317 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.318 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.319 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.320 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.321 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "localpool", 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "failure_domain": { 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "failure_domain", 2024-09-19T07:25:08.322 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "host", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.323 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.324 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.325 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.326 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.327 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.328 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": { 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_size", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:25:08.329 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "num_rep": { 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "num_rep", 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-19T07:25:08.330 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": { 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_num", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.331 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "128", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "prefix": { 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prefix", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.332 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "subtree": { 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "subtree", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.333 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "rack", 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.334 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mds_autoscaler", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.335 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.336 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.337 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.338 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.339 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirroring", 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.340 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.341 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.342 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.343 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.344 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.345 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "nfs", 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.346 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.347 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.348 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.349 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.350 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.351 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "fail_fs": { 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "fail_fs", 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.352 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.353 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.354 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.355 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.356 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.357 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator": { 2024-09-19T07:25:08.358 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "rook", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "test_orchestrator" 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Orchestrator backend", 2024-09-19T07:25:08.359 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_perf_query", 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.360 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.361 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.362 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.363 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.364 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.365 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_support", 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.366 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.367 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.368 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.369 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.370 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_autoscaler", 2024-09-19T07:25:08.371 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.372 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.373 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.374 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.375 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.376 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.377 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "threshold": { 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threshold", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1.0", 2024-09-19T07:25:08.378 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "scaling threshold", 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "progress", 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.379 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_pg_recovery_event": { 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.380 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.381 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.382 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.383 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.384 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.385 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.386 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.388 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.388 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.388 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.388 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "max_completed_events": { 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_completed_events", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "50", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.389 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.390 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus", 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "cache": { 2024-09-19T07:25:08.391 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cache", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "exclude_perf_counters": { 2024-09-19T07:25:08.392 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "exclude_perf_counters", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.393 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.394 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.395 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.396 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.397 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.398 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools": { 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.399 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "300", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.400 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_interval": { 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_interval", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15.0", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.401 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.402 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "9283", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.403 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "stale_cache_strategy": { 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stale_cache_strategy", 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "log", 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.404 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "default", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.405 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "default", 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "error" 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.406 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.407 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.408 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.409 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.410 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.411 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.412 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_snap_create": { 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.413 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.414 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "trash_purge_schedule": { 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "trash_purge_schedule", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.415 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "restful", 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.416 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_auth": { 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_auth", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-19T07:25:08.417 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.418 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.419 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.420 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.421 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.422 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.423 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.424 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.425 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rgw", 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.426 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.427 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.428 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.429 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.430 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.431 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.432 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rook", 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.433 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.434 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.435 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.436 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.437 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.438 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_class": { 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "storage_class", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "local", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.439 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "selftest", 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.440 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.441 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.442 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.443 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.444 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.445 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "roption1": { 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption1", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.446 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "roption2": { 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption2", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "xyz", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.447 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption1": { 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption1", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.448 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption2": { 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption2", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.449 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption3": { 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption3", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.450 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption4": { 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption4", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.451 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption5": { 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption5", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.452 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption6": { 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption6", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.453 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption7": { 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption7", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "42", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.454 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "testkey": { 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testkey", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.455 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "testlkey": { 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testlkey", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.456 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "testnewline": { 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testnewline", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.457 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snap_schedule", 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.458 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_m_granularity": { 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_m_granularity", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.459 INFO:teuthology.orchestra.run.smithi029.stdout: "dump_on_update": { 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dump_on_update", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.460 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.461 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.462 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.463 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.465 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stats", 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.466 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.467 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.468 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.469 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.470 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.471 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "status", 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.472 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.473 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.474 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.475 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.476 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.477 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telegraf", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "address": { 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "address", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.478 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.479 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.480 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.481 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.482 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.483 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.484 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telemetry", 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.485 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_basic": { 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_basic", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.486 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_crash": { 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_crash", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.487 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_device": { 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_device", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.488 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_ident": { 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_ident", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.489 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_perf": { 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_perf", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.490 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "contact": { 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "contact", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.491 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "description": { 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "description", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.492 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "device_url": { 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_url", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.493 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.494 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "24", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "8", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.495 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "last_opt_revision": { 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "last_opt_revision", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.496 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard": { 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.497 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard_description": { 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard_description", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.498 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.499 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.501 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.502 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.503 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "organization": { 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "organization", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.504 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "proxy": { 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "proxy", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.505 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "url": { 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.506 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.507 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "test_orchestrator", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.508 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.509 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.510 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.511 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.512 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.513 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.514 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.515 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.516 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.517 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.518 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_clones": { 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_clones", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:25:08.519 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "periodic_async_work": { 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "periodic_async_work", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.520 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Periodically check for async work", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_delay": { 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.521 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.522 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix", 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "discovery_interval": { 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "discovery_interval", 2024-09-19T07:25:08.523 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "100", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "identifier": { 2024-09-19T07:25:08.524 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "identifier", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.525 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.526 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.527 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.528 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.529 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.530 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.531 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_host": { 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_host", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.532 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_port": { 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_port", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10051", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.533 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_sender": { 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_sender", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.534 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "modules": [ 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "dashboard", 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "iostat", 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "nfs", 2024-09-19T07:25:08.535 INFO:teuthology.orchestra.run.smithi029.stdout: "restful" 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "available_modules": [ 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "alerts", 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.536 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.537 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.538 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.539 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.540 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.541 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.542 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_destination": { 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_destination", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.543 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_from_name": { 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_from_name", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "Ceph", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Email From: name", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.544 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_host": { 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_host", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP server", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.545 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_password": { 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_password", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Password to authenticate with", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.546 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_port": { 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_port", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "465", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP port", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.547 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_sender": { 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_sender", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.548 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_ssl": { 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_ssl", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.549 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "smtp_user": { 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "smtp_user", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "User to authenticate as", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.550 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "balancer", 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "active": { 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "active", 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.551 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_time": { 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_time", 2024-09-19T07:25:08.552 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0000", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "begin_weekday": { 2024-09-19T07:25:08.553 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "begin_weekday", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.554 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_max_iterations": { 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "25", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "250", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.555 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_metrics": { 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_metrics", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:25:08.556 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "crush_compat_step": { 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crush_compat_step", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.5", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0.001", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "0.999", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:25:08.557 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "end_time": { 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_time", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2359", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.558 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "end_weekday": { 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "end_weekday", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "0", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "6", 2024-09-19T07:25:08.559 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.560 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.561 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.562 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.563 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.564 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "min_score": { 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_score", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.565 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.566 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "upmap", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "crush-compat", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "none", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "read", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap-read" 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Balancer mode", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.567 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_ids": { 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_ids", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:25:08.568 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:25:08.569 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_deviation": { 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_deviation", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.570 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "upmap_max_optimizations": { 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.571 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm", 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.572 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_down_multiplier": { 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_down_multiplier", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.573 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_refresh_rate": { 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_refresh_rate", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "20", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.574 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "agent_starting_port": { 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "agent_starting_port", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4721", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.575 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_ptrace": { 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_ptrace", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:25:08.576 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_interval": { 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_interval", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.577 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0.7", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:25:08.578 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm_log_destination": { 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cephadm_log_destination", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "file", 2024-09-19T07:25:08.579 INFO:teuthology.orchestra.run.smithi029.stdout: "file,syslog", 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "syslog" 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "cgroups_split": { 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cgroups_split", 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.580 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "config_checks_enabled": { 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_checks_enabled", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.581 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "config_dashboard": { 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_dashboard", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.582 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_alertmanager": { 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_alertmanager", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.583 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_base": { 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_base", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.584 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_elasticsearch": { 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:25:08.585 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "elasticsearch container image", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_grafana": { 2024-09-19T07:25:08.586 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_grafana", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_haproxy": { 2024-09-19T07:25:08.587 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_haproxy", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "HAproxy container image", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.588 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_agent": { 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.589 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_collector": { 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.590 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_jaeger_query": { 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Jaeger query container image", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.591 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_keepalived": { 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_keepalived", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Keepalived container image", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.592 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_loki": { 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_loki", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Loki container image", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.593 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_node_exporter": { 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_node_exporter", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.594 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_nvmeof": { 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_nvmeof", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Nvme-of container image", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.595 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_prometheus": { 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_prometheus", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Prometheus container image", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.596 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_promtail": { 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_promtail", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Promtail container image", 2024-09-19T07:25:08.597 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_samba": { 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_samba", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:25:08.598 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "container_image_snmp_gateway": { 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.599 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "container_init": { 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "container_init", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.600 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "daemon_cache_timeout": { 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.601 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "900", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.602 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "default_registry": { 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "default_registry", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "docker.io", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.603 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "device_cache_timeout": { 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_cache_timeout", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1800", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.604 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "device_enhanced_scan": { 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_enhanced_scan", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.605 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "facts_cache_timeout": { 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "facts_cache_timeout", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.606 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "grafana_dashboards_path": { 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.607 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "host_check_interval": { 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "host_check_interval", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.608 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "hw_monitoring": { 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hw_monitoring", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.609 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "inventory_list_all": { 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "inventory_list_all", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.610 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.611 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.612 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "log_refresh_metadata": { 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_refresh_metadata", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.613 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.614 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.615 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.616 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.617 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.618 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "*", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.619 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "max_count_per_host": { 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_count_per_host", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.620 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "max_osd_draining_count": { 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_osd_draining_count", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.621 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "migration_current": { 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "migration_current", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "internal - do not modify", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.622 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "mode": { 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mode", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "root", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm-package", 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: "root" 2024-09-19T07:25:08.623 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "oob_default_addr": { 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "oob_default_addr", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "169.254.1.1", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.624 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "prometheus_alerts_path": { 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.625 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_insecure": { 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_insecure", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.626 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_password": { 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_password", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.627 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_url": { 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_url", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.628 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "registry_username": { 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "registry_username", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.629 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "secure_monitoring_stack": { 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.630 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "service_discovery_port": { 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "service_discovery_port", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.631 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8765", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "ssh_config_file": { 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssh_config_file", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.632 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "use_agent": { 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_agent", 2024-09-19T07:25:08.633 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "use_repo_digest": { 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "use_repo_digest", 2024-09-19T07:25:08.634 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_failed_host_check": { 2024-09-19T07:25:08.635 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.636 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_daemons": { 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.637 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_on_stray_hosts": { 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.638 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crash", 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.639 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.640 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.641 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.642 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.643 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "retain_interval": { 2024-09-19T07:25:08.644 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retain_interval", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "31536000", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_recent_interval": { 2024-09-19T07:25:08.645 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_recent_interval", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1209600", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.646 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dashboard", 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.647 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.648 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.649 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.650 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.651 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.652 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.653 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.654 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.655 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.656 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.657 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.658 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.659 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.660 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:25:08.661 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:25:08.662 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_URL": { 2024-09-19T07:25:08.663 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:25:08.664 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.665 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.666 INFO:teuthology.orchestra.run.smithi029.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.667 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.668 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.669 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.670 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.671 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.672 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.673 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.674 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.675 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.676 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.677 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.678 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.679 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:25:08.680 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.681 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.682 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.683 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "45", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.684 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.685 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "admin", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.686 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.687 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:25:08.688 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:25:08.689 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:25:08.690 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "cross_origin_url": { 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cross_origin_url", 2024-09-19T07:25:08.691 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "crt_file": { 2024-09-19T07:25:08.692 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "crt_file", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "debug": { 2024-09-19T07:25:08.693 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "debug", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.694 INFO:teuthology.orchestra.run.smithi029.stdout: "jwt_token_ttl": { 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "jwt_token_ttl", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "28800", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.695 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.696 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.697 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.698 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.699 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.700 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.701 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "motd": { 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "motd", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "The message of the day", 2024-09-19T07:25:08.702 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.703 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.704 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8080", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.705 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.706 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl_server_port": { 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl_server_port", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8443", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.707 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "redirect", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.708 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "redirect" 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-19T07:25:08.709 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "url_prefix": { 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url_prefix", 2024-09-19T07:25:08.710 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.711 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_monitoring": { 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_monitoring", 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.712 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "monitor device health metrics", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.713 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.714 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.715 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.716 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.717 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "mark_out_threshold": { 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mark_out_threshold", 2024-09-19T07:25:08.718 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "2419200", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "pool_name": { 2024-09-19T07:25:08.719 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pool_name", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "device_health_metrics", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "retention_period": { 2024-09-19T07:25:08.720 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "retention_period", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15552000", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.721 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_frequency": { 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_frequency", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.722 INFO:teuthology.orchestra.run.smithi029.stdout: "self_heal": { 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "self_heal", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.723 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.724 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "warn_threshold": { 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "warn_threshold", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7257600", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.725 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "diskprediction_local", 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.726 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.727 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.728 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.729 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.730 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.731 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "predict_interval": { 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predict_interval", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "86400", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.732 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "predictor_model": { 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "predictor_model", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "prophetstor", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.733 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "600", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.734 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "influx", 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": false, 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "batch_size": { 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "batch_size", 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.735 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5000", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "database": { 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "database", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.736 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "ceph", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "hostname": { 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "hostname", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.737 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.738 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "30", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "5", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.739 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.740 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.741 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.742 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.743 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.744 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "password": { 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "password", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.745 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "port": { 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "port", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "8086", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "InfluxDB server port", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.746 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "ssl": { 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ssl", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "false", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.747 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "threads": { 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threads", 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "32", 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.748 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "username": { 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "username", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.749 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "verify_ssl": { 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "verify_ssl", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "true", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.750 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "insights", 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.751 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.752 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.753 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.754 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.755 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.756 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "iostat", 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.757 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.758 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.759 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.760 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.761 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.762 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "k8sevents", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "ceph_event_retention_days": { 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "7", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:25:08.763 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "config_check_secs": { 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "config_check_secs", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "10", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.764 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.765 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.766 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.767 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.768 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.769 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "localpool", 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.770 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "failure_domain": { 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "failure_domain", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "host", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:25:08.771 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.772 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.773 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.774 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.775 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.776 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "min_size": { 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "min_size", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.777 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "num_rep": { 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "num_rep", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.778 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_num": { 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_num", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "128", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.779 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "prefix": { 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prefix", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.780 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "subtree": { 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "subtree", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "rack", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.781 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mds_autoscaler", 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.782 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.783 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.784 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.785 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.786 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.787 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirroring", 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.788 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.789 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.790 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.791 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.792 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.793 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "nfs", 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.794 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.796 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.797 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.798 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.799 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.800 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "fail_fs": { 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "fail_fs", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.801 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.802 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.803 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.804 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.805 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.806 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator": { 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "orchestrator", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.807 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "cephadm", 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "rook", 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "test_orchestrator" 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Orchestrator backend", 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.808 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_perf_query", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.809 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.810 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.811 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.812 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.813 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "osd_support", 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.814 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.815 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.816 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.817 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.818 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.819 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "pg_autoscaler", 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.820 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.821 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.822 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.823 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.824 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.825 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.826 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "threshold": { 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "threshold", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "3.0", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1.0", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "scaling threshold", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:25:08.827 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "progress", 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_pg_recovery_event": { 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.828 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.829 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.830 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.831 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.832 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.833 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.834 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "max_completed_events": { 2024-09-19T07:25:08.835 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_completed_events", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "50", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.836 INFO:teuthology.orchestra.run.smithi029.stdout: "sleep_interval": { 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "sleep_interval", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.837 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "prometheus", 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "cache": { 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "cache", 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.838 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "exclude_perf_counters": { 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "exclude_perf_counters", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.839 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.840 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.841 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.842 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.843 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.844 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools": { 2024-09-19T07:25:08.845 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.846 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "300", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.847 INFO:teuthology.orchestra.run.smithi029.stdout: "scrape_interval": { 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "scrape_interval", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15.0", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.848 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "::", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.849 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "9283", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.850 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "stale_cache_strategy": { 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stale_cache_strategy", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "log", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.851 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_behaviour": { 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_behaviour", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "default", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "default", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "error" 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.852 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "standby_error_status_code": { 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "standby_error_status_code", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "500", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "400", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "599", 2024-09-19T07:25:08.853 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.854 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.855 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.856 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.857 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.858 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.859 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_snap_create": { 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.860 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.861 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "trash_purge_schedule": { 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "trash_purge_schedule", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.862 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "restful", 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "enable_auth": { 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enable_auth", 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.863 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "key_file": { 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "key_file", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.864 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.865 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.866 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.867 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.868 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.869 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "server_addr": { 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_addr", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.870 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "server_port": { 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "server_port", 2024-09-19T07:25:08.871 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.872 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rgw", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.873 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.874 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.875 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.876 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.878 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "5", 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.879 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rook", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.880 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.881 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.882 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.883 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.884 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "storage_class": { 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "storage_class", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "local", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.885 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "selftest", 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.886 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.887 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.888 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.889 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.890 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.891 INFO:teuthology.orchestra.run.smithi029.stdout: "roption1": { 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption1", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.892 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "roption2": { 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "roption2", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "xyz", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.893 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption1": { 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption1", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.894 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption2": { 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption2", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.895 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption3": { 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption3", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "float", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.896 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption4": { 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption4", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.897 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption5": { 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption5", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.898 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption6": { 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption6", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.899 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "rwoption7": { 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rwoption7", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "1", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "42", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.900 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "testkey": { 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testkey", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.901 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "testlkey": { 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testlkey", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.902 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "testnewline": { 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "testnewline", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.903 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snap_schedule", 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "allow_m_granularity": { 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "allow_m_granularity", 2024-09-19T07:25:08.904 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "dump_on_update": { 2024-09-19T07:25:08.905 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "dump_on_update", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.906 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.907 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.908 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.909 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.910 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.911 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "stats", 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.912 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.913 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.914 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.915 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.916 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.917 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "status", 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.918 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.919 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.920 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.921 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.922 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telegraf", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.923 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "address": { 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "address", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.924 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "15", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.925 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.926 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.927 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.928 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.929 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.930 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "telemetry", 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_basic": { 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_basic", 2024-09-19T07:25:08.931 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_crash": { 2024-09-19T07:25:08.932 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_crash", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.933 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_device": { 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_device", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.934 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_ident": { 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_ident", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.935 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "channel_perf": { 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "channel_perf", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.936 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "contact": { 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "contact", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.937 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "description": { 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "description", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.938 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "device_url": { 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "device_url", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.939 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": { 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "enabled", 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.940 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "24", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "8", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.941 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "last_opt_revision": { 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "last_opt_revision", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "1", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.942 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard": { 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.943 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "leaderboard_description": { 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "leaderboard_description", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.944 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.945 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.946 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.947 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.948 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.949 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "organization": { 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "organization", 2024-09-19T07:25:08.950 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "proxy": { 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "proxy", 2024-09-19T07:25:08.951 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "url": { 2024-09-19T07:25:08.952 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "url", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.953 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "test_orchestrator", 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.954 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.955 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.956 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.957 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.958 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-19T07:25:08.959 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.960 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.961 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.962 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.963 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.964 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "max_concurrent_clones": { 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "max_concurrent_clones", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "4", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.965 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "periodic_async_work": { 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "periodic_async_work", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.966 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Periodically check for async work", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_delay": { 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "0", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.967 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "True", 2024-09-19T07:25:08.968 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix", 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "can_run": true, 2024-09-19T07:25:08.969 INFO:teuthology.orchestra.run.smithi029.stdout: "error_string": "", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "module_options": { 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "discovery_interval": { 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "discovery_interval", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "uint", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "100", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.970 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "identifier": { 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "identifier", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.971 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "interval": { 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "interval", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "secs", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "60", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.972 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "log_level": { 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_level", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.973 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster": { 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster", 2024-09-19T07:25:08.974 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_cluster_level": { 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_cluster_level", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.975 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "info", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [ 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "critical", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "debug", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "error", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "info", 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "warning" 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.976 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "log_to_file": { 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "log_to_file", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "bool", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 1, 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "False", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.977 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_host": { 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_host", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.978 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_port": { 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_port", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "int", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "10051", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.979 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "zabbix_sender": { 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "zabbix_sender", 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "str", 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "level": "advanced", 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "flags": 0, 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:25:08.980 INFO:teuthology.orchestra.run.smithi029.stdout: "min": "", 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "max": "", 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "enum_allowed": [], 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "desc": "", 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "long_desc": "", 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "see_also": [] 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "services": { 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "dashboard": "https://172.21.15.29:8443/" 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.981 INFO:teuthology.orchestra.run.smithi029.stdout: "always_on_modules": { 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "octopus": [ 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.982 INFO:teuthology.orchestra.run.smithi029.stdout: "pacific": [ 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "quincy": [ 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-19T07:25:08.983 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "reef": [ 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-19T07:25:08.984 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "squid": [ 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "balancer", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "crash", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "devicehealth", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "orchestrator", 2024-09-19T07:25:08.985 INFO:teuthology.orchestra.run.smithi029.stdout: "pg_autoscaler", 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "progress", 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "rbd_support", 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "status", 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "telemetry", 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "volumes" 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "last_failure_osd_epoch": 3, 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "active_clients": [ 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "devicehealth", 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.986 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 2560148104 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "libcephsqlite", 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 482868887 2024-09-19T07:25:08.987 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "rbd_support", 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 819719028 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-19T07:25:08.988 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "volumes", 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: "addrvec": [ 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "v2", 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: "addr": "172.21.15.29:0", 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: "nonce": 3214920861 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout: ] 2024-09-19T07:25:08.989 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-19T07:25:08.991 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:08 smithi046 ceph-mon[34147]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.9 MiB/s wr, 848 op/s 2024-09-19T07:25:08.991 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:08 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2102920099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T07:25:08.991 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:08 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1025771018' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:25:08.991 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:08 smithi078 ceph-mon[34556]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.9 MiB/s wr, 848 op/s 2024-09-19T07:25:08.991 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:08 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2102920099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T07:25:08.991 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:08 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1025771018' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9fc00a3250 msgr2=0x7f9fc00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9fc00a3250 0x7f9fc00a5710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4199310 tx=0x7f9fc4005f90 comp rx=0 tx=0).stop 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 msgr2=0x7f9fd4197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd4197e00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0005940 tx=0x7f9fd00042f0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 shutdown_connections 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f9fc00a3250 0x7f9fc00a5710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd4107830 0x7f9fd419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9fd4104f00 0x7f9fd4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.546+0000 7f9fdc198640 1 --2- 172.21.15.29:0/1025771018 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fd41025d0 0x7f9fd4197e00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.547+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 >> 172.21.15.29:0/1025771018 conn(0x7f9fd40fc190 msgr2=0x7f9fd4103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.547+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 shutdown_connections 2024-09-19T07:25:08.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:07.547+0000 7f9fdc198640 1 -- 172.21.15.29:0/1025771018 wait complete. 2024-09-19T07:25:09.063 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T07:25:09.073 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T07:25:09.073 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:25:09.073 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:25:09.073 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:08 smithi029 ceph-mon[31255]: pgmap v858: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.9 MiB/s wr, 848 op/s 2024-09-19T07:25:09.073 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:08 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2102920099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T07:25:09.074 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:08 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1025771018' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:25:09.099 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:25:09.099 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:25:09.156 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:25:09.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:09 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:09.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:09 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:09.464 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:09.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:09 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.6 MiB/s wr, 708 op/s 2024-09-19T07:25:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:10.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:10.125 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:10 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:25:10.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.6 MiB/s wr, 708 op/s 2024-09-19T07:25:10.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:10.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:10.446 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:10 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: pgmap v859: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.6 MiB/s wr, 708 op/s 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:10.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:10 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' 2024-09-19T07:25:11.308 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:11 smithi029 ceph-mon[31255]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-19T07:25:11.678 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:11 smithi029 ceph-mon[31255]: Unable to set osd_memory_target on smithi029 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T07:25:11.679 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:11 smithi046 ceph-mon[34147]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-19T07:25:11.680 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:11 smithi046 ceph-mon[34147]: Unable to set osd_memory_target on smithi029 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T07:25:11.680 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:11 smithi078 ceph-mon[34556]: Adjusting osd_memory_target on smithi029 to 177.0M 2024-09-19T07:25:11.680 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:11 smithi078 ceph-mon[34556]: Unable to set osd_memory_target on smithi029 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-19T07:25:12.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:12 smithi029 ceph-mon[31255]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-19T07:25:12.374 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:12 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1468929691' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:25:12.448 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:12 smithi078 ceph-mon[34556]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-19T07:25:12.449 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:12 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1468929691' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:25:12.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:12 smithi046 ceph-mon[34147]: pgmap v860: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.0 MiB/s wr, 641 op/s 2024-09-19T07:25:12.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:12 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1468929691' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:25:12.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 -- 172.21.15.29:0/1642975585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c100ca0 msgr2=0x7f5c1c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 --2- 172.21.15.29:0/1642975585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c106840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009930 tx=0x7f5c0c02a420 comp rx=0 tx=0).stop 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 -- 172.21.15.29:0/1642975585 shutdown_connections 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 --2- 172.21.15.29:0/1642975585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c106f50 0x7f5c1c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 --2- 172.21.15.29:0/1642975585 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c106840 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 --2- 172.21.15.29:0/1642975585 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c1002f0 0x7f5c1c1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 -- 172.21.15.29:0/1642975585 >> 172.21.15.29:0/1642975585 conn(0x7f5c1c077210 msgr2=0x7f5c1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 -- 172.21.15.29:0/1642975585 shutdown_connections 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.307+0000 7f5c23894640 1 -- 172.21.15.29:0/1642975585 wait complete. 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 Processor -- start 2024-09-19T07:25:12.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 -- start start 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c1002f0 0x7f5c1c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 0x7f5c1c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c111e50 con 0x7f5c1c106f50 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c111cd0 con 0x7f5c1c100ca0 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c23894640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c111fd0 con 0x7f5c1c1002f0 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c21e31640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 0x7f5c1c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c20e2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c21e31640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 0x7f5c1c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:37304/0 (socket says 172.21.15.29:37304) 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c21e31640 1 -- 172.21.15.29:0/1468929691 learned_addr learned my addr 172.21.15.29:0/1468929691 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.308+0000 7f5c21630640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c1002f0 0x7f5c1c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c20e2f640 1 -- 172.21.15.29:0/1468929691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c1002f0 msgr2=0x7f5c1c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:12.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c20e2f640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c1002f0 0x7f5c1c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c20e2f640 1 -- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 msgr2=0x7f5c1c19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c20e2f640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 0x7f5c1c19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c20e2f640 1 -- 172.21.15.29:0/1468929691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c19f5c0 con 0x7f5c1c100ca0 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c21e31640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 0x7f5c1c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1356479078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4183681078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:12.828 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/48340936 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4173493605 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3569463944 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1689760555 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c20e2f640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c19ab50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009230 tx=0x7f5c0c004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c03f070 con 0x7f5c1c100ca0 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c19f850 con 0x7f5c1c100ca0 2024-09-19T07:25:12.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5c0c003ca0 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c035070 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.309+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c1a7190 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.310+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c1006d0 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.312+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5c0c03b460 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.312+0000 7f5c127fc640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5c080a3240 0x7f5c080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.313+0000 7f5c21630640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5c080a3240 0x7f5c080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.313+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f5c0c0f0540 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.313+0000 7f5c21630640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5c080a3240 0x7f5c080a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009bd0 tx=0x7f5c18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.316+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c0c0bc820 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.502+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c1c1a7390 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.503+0000 7f5c127fc640 1 -- 172.21.15.29:0/1468929691 <== mon.2 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+590 (secure 0 0 0) 0x7f5c0c0c0b20 con 0x7f5c1c100ca0 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:listed 10 entries 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5c080a3240 msgr2=0x7f5c080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:12.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5c080a3240 0x7f5c080a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009bd0 tx=0x7f5c18005f90 comp rx=0 tx=0).stop 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c100ca0 msgr2=0x7f5c1c19ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c19ab50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009230 tx=0x7f5c0c004270 comp rx=0 tx=0).stop 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 shutdown_connections 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c1c106f50 0x7f5c1c19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c1c100ca0 0x7f5c1c19ab50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f5c080a3240 0x7f5c080a5700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 --2- 172.21.15.29:0/1468929691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c1c1002f0 0x7f5c1c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 >> 172.21.15.29:0/1468929691 conn(0x7f5c1c077210 msgr2=0x7f5c1c1057c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 shutdown_connections 2024-09-19T07:25:12.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:11.505+0000 7f5c23894640 1 -- 172.21.15.29:0/1468929691 wait complete. 2024-09-19T07:25:13.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:13 smithi029 ceph-mon[31255]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.4 MiB/s wr, 363 op/s 2024-09-19T07:25:13.445 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:13 smithi078 ceph-mon[34556]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.4 MiB/s wr, 363 op/s 2024-09-19T07:25:13.474 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:13 smithi046 ceph-mon[34147]: pgmap v861: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.4 MiB/s wr, 363 op/s 2024-09-19T07:25:15.377 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-19T07:25:15.378 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:25:15.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:25:15.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:15 smithi029 ceph-mon[31255]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-09-19T07:25:15.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:15 smithi078 ceph-mon[34556]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-09-19T07:25:15.707 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:15.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:15 smithi046 ceph-mon[34147]: pgmap v862: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 149 op/s 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 -- 172.21.15.29:0/3056269263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74101de0 msgr2=0x7f1a741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3056269263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74101de0 0x7f1a741021c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009900 tx=0x7f1a6402a410 comp rx=0 tx=0).stop 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 -- 172.21.15.29:0/3056269263 shutdown_connections 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3056269263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a74106f10 0x7f1a7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3056269263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a74102790 0x7f1a741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3056269263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74101de0 0x7f1a741021c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 -- 172.21.15.29:0/3056269263 >> 172.21.15.29:0/3056269263 conn(0x7f1a740fd8c0 msgr2=0x7f1a740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:16.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 -- 172.21.15.29:0/3056269263 shutdown_connections 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.568+0000 7f1a788a4640 1 -- 172.21.15.29:0/3056269263 wait complete. 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 Processor -- start 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 -- start start 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a74101de0 0x7f1a74198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 0x7f1a74198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a74106f10 0x7f1a7419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74111e20 con 0x7f1a74102790 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74111ca0 con 0x7f1a74101de0 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a788a4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1a74111fa0 con 0x7f1a74106f10 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a71d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 0x7f1a74198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a71d9b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 0x7f1a74198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38850/0 (socket says 172.21.15.29:38850) 2024-09-19T07:25:16.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.569+0000 7f1a71d9b640 1 -- 172.21.15.29:0/3592055323 learned_addr learned my addr 172.21.15.29:0/3592055323 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a7259c640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a74101de0 0x7f1a74198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a71d9b640 1 -- 172.21.15.29:0/3592055323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a74106f10 msgr2=0x7f1a7419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a71d9b640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a74106f10 0x7f1a7419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a71d9b640 1 -- 172.21.15.29:0/3592055323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a74101de0 msgr2=0x7f1a74198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a71d9b640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a74101de0 0x7f1a74198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a71d9b640 1 -- 172.21.15.29:0/3592055323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7419d2d0 con 0x7f1a74102790 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a71d9b640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 0x7f1a74198860 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800d950 tx=0x7f1a6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68017070 con 0x7f1a74102790 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a68009c30 con 0x7f1a74102790 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7419d5c0 con 0x7f1a74102790 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800f620 con 0x7f1a74102790 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.570+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a741a4ea0 con 0x7f1a74102790 2024-09-19T07:25:16.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.571+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a741021c0 con 0x7f1a74102790 2024-09-19T07:25:16.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.572+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1a680109a0 con 0x7f1a74102790 2024-09-19T07:25:16.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.573+0000 7f1a637fe640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1a5c0a3240 0x7f1a5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:16.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.573+0000 7f1a7259c640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1a5c0a3240 0x7f1a5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:16.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.573+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f1a680cfa00 con 0x7f1a74102790 2024-09-19T07:25:16.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.573+0000 7f1a7259c640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1a5c0a3240 0x7f1a5c0a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a64031440 tx=0x7f1a640095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:16.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.577+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a68009de0 con 0x7f1a74102790 2024-09-19T07:25:16.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.766+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1a7402d7c0 con 0x7f1a74102790 2024-09-19T07:25:16.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.767+0000 7f1a637fe640 1 -- 172.21.15.29:0/3592055323 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v92) ==== 81+0+590 (secure 0 0 0) 0x7f1a6809c330 con 0x7f1a74102790 2024-09-19T07:25:16.767 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1356479078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4183681078 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/48340936 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/4173493605 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/1256989766 2024-09-20T06:59:13.753465+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/3569463944 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6801/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:6800/3793715048 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29:0/1689760555 2024-09-20T06:58:48.466085+0000 2024-09-19T07:25:16.768 INFO:teuthology.orchestra.run.smithi029.stderr:listed 10 entries 2024-09-19T07:25:16.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1a5c0a3240 msgr2=0x7f1a5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1a5c0a3240 0x7f1a5c0a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1a64031440 tx=0x7f1a640095f0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 msgr2=0x7f1a74198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 0x7f1a74198860 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800d950 tx=0x7f1a6800de10 comp rx=0 tx=0).stop 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 shutdown_connections 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f1a5c0a3240 0x7f1a5c0a5700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a74106f10 0x7f1a7419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a74102790 0x7f1a74198860 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 --2- 172.21.15.29:0/3592055323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a74101de0 0x7f1a74198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 >> 172.21.15.29:0/3592055323 conn(0x7f1a740fd8c0 msgr2=0x7f1a740fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 shutdown_connections 2024-09-19T07:25:16.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:16.769+0000 7f1a788a4640 1 -- 172.21.15.29:0/3592055323 wait complete. 2024-09-19T07:25:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:17 smithi029 ceph-mon[31255]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 290 KiB/s wr, 36 op/s 2024-09-19T07:25:17.624 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:17 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/3592055323' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:25:17.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:17 smithi078 ceph-mon[34556]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 290 KiB/s wr, 36 op/s 2024-09-19T07:25:17.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:17 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/3592055323' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:25:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:17 smithi046 ceph-mon[34147]: pgmap v863: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 290 KiB/s wr, 36 op/s 2024-09-19T07:25:17.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:17 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/3592055323' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:25:17.877 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi029.front.sepia.ceph.com... 2024-09-19T07:25:17.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:25:17.877 DEBUG:teuthology.orchestra.run.smithi029:> sudo fusermount -u /tmp/cephfs 2024-09-19T07:25:17.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi029.stderr:ceph-fuse[85149]: fuse finished with error 0 and tester_r 0 2024-09-19T07:25:18.017 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T07:25:19.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:19 smithi029 ceph-mon[31255]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.6 KiB/s wr, 4 op/s 2024-09-19T07:25:19.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:19 smithi078 ceph-mon[34556]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.6 KiB/s wr, 4 op/s 2024-09-19T07:25:19.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:19 smithi046 ceph-mon[34147]: pgmap v864: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 5.6 KiB/s wr, 4 op/s 2024-09-19T07:25:21.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:21 smithi029 ceph-mon[31255]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.2 KiB/s wr, 3 op/s 2024-09-19T07:25:21.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:21 smithi078 ceph-mon[34556]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.2 KiB/s wr, 3 op/s 2024-09-19T07:25:21.724 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:21 smithi046 ceph-mon[34147]: pgmap v865: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.2 KiB/s wr, 3 op/s 2024-09-19T07:25:23.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:23 smithi029 ceph-mon[31255]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-09-19T07:25:23.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:23 smithi078 ceph-mon[34556]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-09-19T07:25:23.724 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:23 smithi046 ceph-mon[34147]: pgmap v866: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.7 KiB/s wr, 4 op/s 2024-09-19T07:25:24.118 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T07:25:24.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:25:24.119 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:25:24.148 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2024-09-19T07:25:24.230 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-19T07:25:24.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:25:24.231 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-19T07:25:24.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:25:24.304 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2024-09-19T07:25:24.402 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T07:25:24.413 INFO:tasks.cephadm:Teardown begin 2024-09-19T07:25:24.413 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T07:25:24.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:25:24.680 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 -- 172.21.15.29:0/3960526990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 msgr2=0x7ff39810ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 --2- 172.21.15.29:0/3960526990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff39810ea60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff390009ca0 tx=0x7ff39002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 -- 172.21.15.29:0/3960526990 shutdown_connections 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 --2- 172.21.15.29:0/3960526990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff39810ea60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 --2- 172.21.15.29:0/3960526990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3981000d0 0x7ff398100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 --2- 172.21.15.29:0/3960526990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398106ba0 0x7ff398106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 -- 172.21.15.29:0/3960526990 >> 172.21.15.29:0/3960526990 conn(0x7ff398077210 msgr2=0x7ff3980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 -- 172.21.15.29:0/3960526990 shutdown_connections 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.167+0000 7ff39d691640 1 -- 172.21.15.29:0/3960526990 wait complete. 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.168+0000 7ff39d691640 1 Processor -- start 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.168+0000 7ff39d691640 1 -- start start 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.168+0000 7ff39d691640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3981000d0 0x7ff3981012b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.168+0000 7ff39d691640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff3981017f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.168+0000 7ff39d691640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398106ba0 0x7ff398101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff39d691640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7ff398111f40 con 0x7ff398100a70 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff39d691640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff398111dc0 con 0x7ff3981000d0 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff39d691640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff3981120c0 con 0x7ff398106ba0 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff3981017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff3981017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:38868/0 (socket says 172.21.15.29:38868) 2024-09-19T07:25:25.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 -- 172.21.15.29:0/588005235 learned_addr learned my addr 172.21.15.29:0/588005235 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff396ffd640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3981000d0 0x7ff3981012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff3977fe640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398106ba0 0x7ff398101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 -- 172.21.15.29:0/588005235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398106ba0 msgr2=0x7ff398101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398106ba0 0x7ff398101d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 -- 172.21.15.29:0/588005235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3981000d0 msgr2=0x7ff3981012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3981000d0 0x7ff3981012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 -- 172.21.15.29:0/588005235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3981a67e0 con 0x7ff398100a70 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff38e7fc640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff3981017f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff38000c920 tx=0x7ff38000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380007c70 con 0x7ff398100a70 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3981a6ad0 con 0x7ff398100a70 2024-09-19T07:25:25.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff380007e10 con 0x7ff398100a70 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380018820 con 0x7ff398100a70 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.169+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3981a7060 con 0x7ff398100a70 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.171+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff398100530 con 0x7ff398100a70 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.172+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff3800189c0 con 0x7ff398100a70 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.172+0000 7ff394ff9640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff3840a3240 0x7ff3840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.173+0000 7ff396ffd640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff3840a3240 0x7ff3840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.173+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7ff3800cfea0 con 0x7ff398100a70 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.173+0000 7ff396ffd640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff3840a3240 0x7ff3840a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff388005d90 tx=0x7ff388005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.177+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff380014030 con 0x7ff398100a70 2024-09-19T07:25:25.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.392+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3981027e0 con 0x7ff398100a70 2024-09-19T07:25:25.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.393+0000 7ff394ff9640 1 -- 172.21.15.29:0/588005235 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7ff38000de20 con 0x7ff398100a70 2024-09-19T07:25:25.393 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:25.394 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:25:25.394 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff3840a3240 msgr2=0x7ff3840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff3840a3240 0x7ff3840a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff388005d90 tx=0x7ff388005d20 comp rx=0 tx=0).stop 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 msgr2=0x7ff3981017f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff3981017f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff38000c920 tx=0x7ff38000cde0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 shutdown_connections 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7ff3840a3240 0x7ff3840a5700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff398106ba0 0x7ff398101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff398100a70 0x7ff3981017f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 --2- 172.21.15.29:0/588005235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3981000d0 0x7ff3981012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 >> 172.21.15.29:0/588005235 conn(0x7ff398077210 msgr2=0x7ff3980fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 shutdown_connections 2024-09-19T07:25:25.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:25.395+0000 7ff39d691640 1 -- 172.21.15.29:0/588005235 wait complete. 2024-09-19T07:25:25.623 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:25 smithi029 ceph-mon[31255]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.1 KiB/s wr, 3 op/s 2024-09-19T07:25:25.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:25 smithi078 ceph-mon[34556]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.1 KiB/s wr, 3 op/s 2024-09-19T07:25:25.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:25 smithi046 ceph-mon[34147]: pgmap v867: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.1 KiB/s wr, 3 op/s 2024-09-19T07:25:26.155 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:25:26.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:26 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/588005235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:26.418 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:26.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:26 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/588005235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:26.724 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:26 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/588005235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 -- 172.21.15.29:0/869198528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 msgr2=0x7fc40c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 --2- 172.21.15.29:0/869198528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c100cb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc408009900 tx=0x7fc40802a410 comp rx=0 tx=0).stop 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 -- 172.21.15.29:0/869198528 shutdown_connections 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 --2- 172.21.15.29:0/869198528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c10e480 0x7fc40c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 --2- 172.21.15.29:0/869198528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc40c101280 0x7fc40c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 --2- 172.21.15.29:0/869198528 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c100cb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.927+0000 7fc4140c2640 1 -- 172.21.15.29:0/869198528 >> 172.21.15.29:0/869198528 conn(0x7fc40c0fc7a0 msgr2=0x7fc40c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 -- 172.21.15.29:0/869198528 shutdown_connections 2024-09-19T07:25:26.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 -- 172.21.15.29:0/869198528 wait complete. 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 Processor -- start 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 -- start start 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c101280 0x7fc40c19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc40c10e480 0x7fc40c19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1140b0 con 0x7fc40c1008d0 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c113f30 con 0x7fc40c10e480 2024-09-19T07:25:26.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc4140c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c114230 con 0x7fc40c101280 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc411e5e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc411e5e640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50728/0 (socket says 172.21.15.29:50728) 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.928+0000 7fc411e5e640 1 -- 172.21.15.29:0/573929344 learned_addr learned my addr 172.21.15.29:0/573929344 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc41265f640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc40c10e480 0x7fc40c19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc41165d640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c101280 0x7fc40c19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc411e5e640 1 -- 172.21.15.29:0/573929344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c101280 msgr2=0x7fc40c19ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc411e5e640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c101280 0x7fc40c19ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc411e5e640 1 -- 172.21.15.29:0/573929344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc40c10e480 msgr2=0x7fc40c19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:26.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc411e5e640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc40c10e480 0x7fc40c19eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc411e5e640 1 -- 172.21.15.29:0/573929344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c19f580 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc41165d640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c101280 0x7fc40c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc411e5e640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c19a5d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc408005ab0 tx=0x7fc408003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40803f070 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc408031d60 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c19f810 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408035030 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.929+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1a7150 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.930+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c100cb0 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.932+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc408042070 con 0x7fc40c1008d0 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.932+0000 7fc402ffd640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f80a32c0 0x7fc3f80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:26.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.932+0000 7fc41165d640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f80a32c0 0x7fc3f80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.932+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7fc4080f0aa0 con 0x7fc40c1008d0 2024-09-19T07:25:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.933+0000 7fc41165d640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f80a32c0 0x7fc3f80a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc40c10e8a0 tx=0x7fc3fc005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:26.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:26.936+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4080bd430 con 0x7fc40c1008d0 2024-09-19T07:25:27.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.148+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc40c109610 con 0x7fc40c1008d0 2024-09-19T07:25:27.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.149+0000 7fc402ffd640 1 -- 172.21.15.29:0/573929344 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+11836 (secure 0 0 0) 0x7fc4080bcd30 con 0x7fc40c1008d0 2024-09-19T07:25:27.150 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:27.150 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":20,"btime":"2024-09-19T07:07:03:013138+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3800844322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":3800844322},{"type":"v1","addr":"172.21.15.29:6835","nonce":3800844322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6837/2671963578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6836","nonce":2671963578},{"type":"v1","addr":"172.21.15.29:6837","nonce":2671963578}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6839/680020224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6838","nonce":680020224},{"type":"v1","addr":"172.21.15.29:6839","nonce":680020224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6841/2441165637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6840","nonce":2441165637},{"type":"v1","addr":"172.21.15.29:6841","nonce":2441165637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6833/2053493152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":2053493152},{"type":"v1","addr":"172.21.15.46:6833","nonce":2053493152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1477599720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1477599720},{"type":"v1","addr":"172.21.15.78:6833","nonce":1477599720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24440,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/3031735721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":3031735721},{"type":"v1","addr":"172.21.15.46:6835","nonce":3031735721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24461,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/1039888184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":1039888184},{"type":"v1","addr":"172.21.15.46:6837","nonce":1039888184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1553207007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1553207007},{"type":"v1","addr":"172.21.15.78:6835","nonce":1553207007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/3493854055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":3493854055},{"type":"v1","addr":"172.21.15.78:6837","nonce":3493854055}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:06:25.493071+0000","modified":"2024-09-19T07:07:02.814825+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24488":{"gid":24488,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/865095783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":865095783},{"type":"v1","addr":"172.21.15.46:6839","nonce":865095783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.78:6839/2907917016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6838","nonce":2907917016},{"type":"v1","addr":"172.21.15.78:6839","nonce":2907917016}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24499,"qdb_cluster":[24499]},"id":1}]} 2024-09-19T07:25:27.150 INFO:teuthology.orchestra.run.smithi029.stderr:dumped fsmap epoch 20 2024-09-19T07:25:27.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f80a32c0 msgr2=0x7fc3f80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:27.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f80a32c0 0x7fc3f80a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc40c10e8a0 tx=0x7fc3fc005e50 comp rx=0 tx=0).stop 2024-09-19T07:25:27.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 msgr2=0x7fc40c19a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c19a5d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc408005ab0 tx=0x7fc408003cd0 comp rx=0 tx=0).stop 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 shutdown_connections 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc40c10e480 0x7fc40c19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fc3f80a32c0 0x7fc3f80a5780 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc40c101280 0x7fc40c19ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 --2- 172.21.15.29:0/573929344 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc40c1008d0 0x7fc40c19a5d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 >> 172.21.15.29:0/573929344 conn(0x7fc40c0fc7a0 msgr2=0x7fc40c10f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 shutdown_connections 2024-09-19T07:25:27.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:27.151+0000 7fc4140c2640 1 -- 172.21.15.29:0/573929344 wait complete. 2024-09-19T07:25:27.537 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:27 smithi029 ceph-mon[31255]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T07:25:27.538 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:27 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/573929344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:27 smithi078 ceph-mon[34556]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T07:25:27.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:27 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/573929344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:27 smithi046 ceph-mon[34147]: pgmap v868: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T07:25:27.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:27 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/573929344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:27.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:25:28.160 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 -- 172.21.15.29:0/2000637288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4670102d30 msgr2=0x7f4670103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 --2- 172.21.15.29:0/2000637288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4670102d30 0x7f4670103110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f466c009930 tx=0x7f466c02a420 comp rx=0 tx=0).stop 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 -- 172.21.15.29:0/2000637288 shutdown_connections 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 --2- 172.21.15.29:0/2000637288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 0x7f467010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 --2- 172.21.15.29:0/2000637288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46701036e0 0x7f4670107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 --2- 172.21.15.29:0/2000637288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4670102d30 0x7f4670103110 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 -- 172.21.15.29:0/2000637288 >> 172.21.15.29:0/2000637288 conn(0x7f46700fc7d0 msgr2=0x7f46700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 -- 172.21.15.29:0/2000637288 shutdown_connections 2024-09-19T07:25:28.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.816+0000 7f46781d6640 1 -- 172.21.15.29:0/2000637288 wait complete. 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.817+0000 7f46781d6640 1 Processor -- start 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.817+0000 7f46781d6640 1 -- start start 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.817+0000 7f46781d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4670102d30 0x7f4670198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.817+0000 7f46781d6640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 0x7f4670198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.817+0000 7f46781d6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 0x7f467019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f46781d6640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4670111f50 con 0x7f46701036e0 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f46781d6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4670111dd0 con 0x7f46701082a0 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f46781d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46701120d0 con 0x7f4670102d30 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 0x7f4670198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 0x7f4670198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50744/0 (socket says 172.21.15.29:50744) 2024-09-19T07:25:28.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 -- 172.21.15.29:0/2991944351 learned_addr learned my addr 172.21.15.29:0/2991944351 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675f72640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4670102d30 0x7f4670198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4676773640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 0x7f467019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 -- 172.21.15.29:0/2991944351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4670102d30 msgr2=0x7f4670198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4670102d30 0x7f4670198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 -- 172.21.15.29:0/2991944351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 msgr2=0x7f467019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 0x7f467019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 -- 172.21.15.29:0/2991944351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467019d4c0 con 0x7f46701036e0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4676773640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 0x7f467019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4675771640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 0x7f4670198a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f466000d750 tx=0x7f466000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660017070 con 0x7f46701036e0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46600054d0 con 0x7f46701036e0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.818+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467019d7b0 con 0x7f46701036e0 2024-09-19T07:25:28.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.819+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4660004cf0 con 0x7f46701036e0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.819+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46701a5090 con 0x7f46701036e0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.820+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467006a850 con 0x7f46701036e0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.821+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4660004e90 con 0x7f46701036e0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.822+0000 7f4666ffd640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32c0 0x7f465c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.822+0000 7f4675f72640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32c0 0x7f465c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.822+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f46600cf690 con 0x7f46701036e0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.822+0000 7f4675f72640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32c0 0x7f465c0a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f466c000c00 tx=0x7f466c032ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:28.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:28.826+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f466009c020 con 0x7f46701036e0 2024-09-19T07:25:29.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.020+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f467010a2b0 con 0x7f46701036e0 2024-09-19T07:25:29.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.022+0000 7f4666ffd640 1 -- 172.21.15.29:0/2991944351 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24747 (secure 0 0 0) 0x7f466009b920 con 0x7f46701036e0 2024-09-19T07:25:29.023 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-19T07:25:29.023 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":92,"fsid":"6a046fca-7654-11ef-bceb-c7b262605968","created":"2024-09-19T06:58:24.064514+0000","modified":"2024-09-19T07:08:15.648219+0000","last_up_change":"2024-09-19T07:05:33.354585+0000","last_in_change":"2024-09-19T07:05:09.874515+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:01:36.264211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:06:21.388575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:06:23.758331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T07:06:30.244020+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"18b7cd4a-16e1-4292-8991-1c3e988879b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6803","nonce":1401604142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6805","nonce":1401604142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6809","nonce":1401604142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":1401604142},{"type":"v1","addr":"172.21.15.29:6807","nonce":1401604142}]},"public_addr":"172.21.15.29:6803/1401604142","cluster_addr":"172.21.15.29:6805/1401604142","heartbeat_back_addr":"172.21.15.29:6809/1401604142","heartbeat_front_addr":"172.21.15.29:6807/1401604142","state":["exists","up"]},{"osd":1,"uuid":"14b5d96f-091a-4d2c-99b2-204239338305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6801","nonce":4060805731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6803","nonce":4060805731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6807","nonce":4060805731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":4060805731},{"type":"v1","addr":"172.21.15.46:6805","nonce":4060805731}]},"public_addr":"172.21.15.46:6801/4060805731","cluster_addr":"172.21.15.46:6803/4060805731","heartbeat_back_addr":"172.21.15.46:6807/4060805731","heartbeat_front_addr":"172.21.15.46:6805/4060805731","state":["exists","up"]},{"osd":2,"uuid":"2d9ff0e5-f31e-4219-97ac-91b84b4aa4d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6801","nonce":2352788305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6803","nonce":2352788305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6807","nonce":2352788305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2352788305},{"type":"v1","addr":"172.21.15.78:6805","nonce":2352788305}]},"public_addr":"172.21.15.78:6801/2352788305","cluster_addr":"172.21.15.78:6803/2352788305","heartbeat_back_addr":"172.21.15.78:6807/2352788305","heartbeat_front_addr":"172.21.15.78:6805/2352788305","state":["exists","up"]},{"osd":3,"uuid":"9fba4b13-f243-4dad-a64c-1f374ee7fdc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6811","nonce":1809490349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6813","nonce":1809490349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6817","nonce":1809490349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1809490349},{"type":"v1","addr":"172.21.15.29:6815","nonce":1809490349}]},"public_addr":"172.21.15.29:6811/1809490349","cluster_addr":"172.21.15.29:6813/1809490349","heartbeat_back_addr":"172.21.15.29:6817/1809490349","heartbeat_front_addr":"172.21.15.29:6815/1809490349","state":["exists","up"]},{"osd":4,"uuid":"4a3fe9f3-e212-42a4-b3c0-06cc2e50c622","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6809","nonce":4193654179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6811","nonce":4193654179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6815","nonce":4193654179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":4193654179},{"type":"v1","addr":"172.21.15.46:6813","nonce":4193654179}]},"public_addr":"172.21.15.46:6809/4193654179","cluster_addr":"172.21.15.46:6811/4193654179","heartbeat_back_addr":"172.21.15.46:6815/4193654179","heartbeat_front_addr":"172.21.15.46:6813/4193654179","state":["exists","up"]},{"osd":5,"uuid":"bb3d9461-1e47-4e1d-be8e-583f94501d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6809","nonce":2442048151}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6811","nonce":2442048151}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6815","nonce":2442048151}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":2442048151},{"type":"v1","addr":"172.21.15.78:6813","nonce":2442048151}]},"public_addr":"172.21.15.78:6809/2442048151","cluster_addr":"172.21.15.78:6811/2442048151","heartbeat_back_addr":"172.21.15.78:6815/2442048151","heartbeat_front_addr":"172.21.15.78:6813/2442048151","state":["exists","up"]},{"osd":6,"uuid":"ca1e52cd-150b-4d71-a9eb-d0cb0b9846cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6819","nonce":4093011599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6821","nonce":4093011599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6825","nonce":4093011599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4093011599},{"type":"v1","addr":"172.21.15.29:6823","nonce":4093011599}]},"public_addr":"172.21.15.29:6819/4093011599","cluster_addr":"172.21.15.29:6821/4093011599","heartbeat_back_addr":"172.21.15.29:6825/4093011599","heartbeat_front_addr":"172.21.15.29:6823/4093011599","state":["exists","up"]},{"osd":7,"uuid":"54e4494b-0f7a-42d4-a840-18a685821466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6817","nonce":669772686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6819","nonce":669772686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6823","nonce":669772686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":669772686},{"type":"v1","addr":"172.21.15.46:6821","nonce":669772686}]},"public_addr":"172.21.15.46:6817/669772686","cluster_addr":"172.21.15.46:6819/669772686","heartbeat_back_addr":"172.21.15.46:6823/669772686","heartbeat_front_addr":"172.21.15.46:6821/669772686","state":["exists","up"]},{"osd":8,"uuid":"0d3f5854-9361-45b2-b1b5-5d1dc46ca568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6817","nonce":738881945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6819","nonce":738881945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6823","nonce":738881945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":738881945},{"type":"v1","addr":"172.21.15.78:6821","nonce":738881945}]},"public_addr":"172.21.15.78:6817/738881945","cluster_addr":"172.21.15.78:6819/738881945","heartbeat_back_addr":"172.21.15.78:6823/738881945","heartbeat_front_addr":"172.21.15.78:6821/738881945","state":["exists","up"]},{"osd":9,"uuid":"b423f53e-8f8b-4ba8-b17d-9a7e19cb9f00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6827","nonce":3365910689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6829","nonce":3365910689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6833","nonce":3365910689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":3365910689},{"type":"v1","addr":"172.21.15.29:6831","nonce":3365910689}]},"public_addr":"172.21.15.29:6827/3365910689","cluster_addr":"172.21.15.29:6829/3365910689","heartbeat_back_addr":"172.21.15.29:6833/3365910689","heartbeat_front_addr":"172.21.15.29:6831/3365910689","state":["exists","up"]},{"osd":10,"uuid":"0d8f44c8-3b48-47ba-80cd-cee544a6cb3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6825","nonce":1753918148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6827","nonce":1753918148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6831","nonce":1753918148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1753918148},{"type":"v1","addr":"172.21.15.46:6829","nonce":1753918148}]},"public_addr":"172.21.15.46:6825/1753918148","cluster_addr":"172.21.15.46:6827/1753918148","heartbeat_back_addr":"172.21.15.46:6831/1753918148","heartbeat_front_addr":"172.21.15.46:6829/1753918148","state":["exists","up"]},{"osd":11,"uuid":"bd582454-ad0c-4343-b2fa-e314def66709","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6825","nonce":442617082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6827","nonce":442617082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6831","nonce":442617082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":442617082},{"type":"v1","addr":"172.21.15.78:6829","nonce":442617082}]},"public_addr":"172.21.15.78:6825/442617082","cluster_addr":"172.21.15.78:6827/442617082","heartbeat_back_addr":"172.21.15.78:6831/442617082","heartbeat_front_addr":"172.21.15.78:6829/442617082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:00:41.273632+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:07.401967+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:32.632990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:01:59.939575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:25.980989+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:02:51.857620+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:17.209461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:03:43.779232+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:09.041196+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:04:38.630098+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:05.699221+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:05:31.454320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.f","mappings":[{"from":5,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":10}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.29:0/1356479078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6800/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/4183681078":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/48340936":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/4173493605":"2024-09-20T06:59:13.753465+0000","172.21.15.29:6801/1256989766":"2024-09-20T06:59:13.753465+0000","172.21.15.29:0/3569463944":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6801/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:6800/3793715048":"2024-09-20T06:58:48.466085+0000","172.21.15.29:0/1689760555":"2024-09-20T06:58:48.466085+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32c0 msgr2=0x7f465c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32c0 0x7f465c0a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f466c000c00 tx=0x7f466c032ba0 comp rx=0 tx=0).stop 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 msgr2=0x7f4670198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 0x7f4670198a50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f466000d750 tx=0x7f466000dc10 comp rx=0 tx=0).stop 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 shutdown_connections 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46701082a0 0x7f467019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46701036e0 0x7f4670198a50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f465c0a32c0 0x7f465c0a5780 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 --2- 172.21.15.29:0/2991944351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4670102d30 0x7f4670198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 >> 172.21.15.29:0/2991944351 conn(0x7f46700fc7d0 msgr2=0x7f4670105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:29.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 shutdown_connections 2024-09-19T07:25:29.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:29.024+0000 7f46781d6640 1 -- 172.21.15.29:0/2991944351 wait complete. 2024-09-19T07:25:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:29 smithi078 ceph-mon[34556]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T07:25:29.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:29 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2991944351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:25:29.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:29 smithi029 ceph-mon[31255]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T07:25:29.723 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:29 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2991944351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:25:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:29 smithi046 ceph-mon[34147]: pgmap v869: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-09-19T07:25:29.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:29 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2991944351' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:25:29.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T07:25:30.013 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:30.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1886928626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4103780 msgr2=0x7f6ca4107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1886928626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4103780 0x7f6ca4107bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009930 tx=0x7f6c8c02a420 comp rx=0 tx=0).stop 2024-09-19T07:25:30.707 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1886928626 shutdown_connections 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1886928626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca4108300 0x7f6ca410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1886928626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4103780 0x7f6ca4107bc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1886928626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca4102dd0 0x7f6ca41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1886928626 >> 172.21.15.29:0/1886928626 conn(0x7f6ca40fc7d0 msgr2=0x7f6ca40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1886928626 shutdown_connections 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.682+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1886928626 wait complete. 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 Processor -- start 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 -- start start 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 0x7f6ca4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca4103780 0x7f6ca4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca4108300 0x7f6ca419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4111f20 con 0x7f6ca4102dd0 2024-09-19T07:25:30.708 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca4111da0 con 0x7f6ca4103780 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca8d0d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41120a0 con 0x7f6ca4108300 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 0x7f6ca4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 0x7f6ca4198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50758/0 (socket says 172.21.15.29:50758) 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca259c640 1 -- 172.21.15.29:0/1925327985 learned_addr learned my addr 172.21.15.29:0/1925327985 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca2d9d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca4108300 0x7f6ca419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.683+0000 7f6ca1d9b640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca4103780 0x7f6ca4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca259c640 1 -- 172.21.15.29:0/1925327985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca4108300 msgr2=0x7f6ca419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca259c640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca4108300 0x7f6ca419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca259c640 1 -- 172.21.15.29:0/1925327985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca4103780 msgr2=0x7f6ca4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca259c640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca4103780 0x7f6ca4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca259c640 1 -- 172.21.15.29:0/1925327985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca419d4b0 con 0x7f6ca4102dd0 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca259c640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 0x7f6ca4198500 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400ebc0 tx=0x7f6c9400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94010630 con 0x7f6ca4102dd0 2024-09-19T07:25:30.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca419d7a0 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6c94010c80 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94018b30 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.684+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca41a5080 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.685+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca41031b0 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.686+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6c94018cd0 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.687+0000 7f6c9b7fe640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6c900a3240 0x7f6c900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.687+0000 7f6ca1d9b640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6c900a3240 0x7f6c900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.687+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9150+0+0 (secure 0 0 0) 0x7f6c940d0390 con 0x7f6ca4102dd0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.688+0000 7f6ca1d9b640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6c900a3240 0x7f6c900a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009900 tx=0x7f6c8c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:30.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.691+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c9409ccc0 con 0x7f6ca4102dd0 2024-09-19T07:25:30.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.903+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6ca410a290 con 0x7f6ca4102dd0 2024-09-19T07:25:30.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.905+0000 7f6c9b7fe640 1 -- 172.21.15.29:0/1925327985 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f6c9409c5c0 con 0x7f6ca4102dd0 2024-09-19T07:25:30.906 INFO:teuthology.orchestra.run.smithi029.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.909+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6c900a3240 msgr2=0x7f6c900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.909+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6c900a3240 0x7f6c900a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c009900 tx=0x7f6c8c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.909+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 msgr2=0x7f6ca4198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.909+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 0x7f6ca4198500 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400ebc0 tx=0x7f6c9400c6a0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.911+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 shutdown_connections 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.911+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f6c900a3240 0x7f6c900a5700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.911+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ca4108300 0x7f6ca419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.911+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca4103780 0x7f6ca4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.911+0000 7f6ca8d0d640 1 --2- 172.21.15.29:0/1925327985 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6ca4102dd0 0x7f6ca4198500 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.911+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 >> 172.21.15.29:0/1925327985 conn(0x7f6ca40fc7d0 msgr2=0x7f6ca4105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.912+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 shutdown_connections 2024-09-19T07:25:30.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:30.912+0000 7f6ca8d0d640 1 -- 172.21.15.29:0/1925327985 wait complete. 2024-09-19T07:25:31.225 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:25:30 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b[63680]: ignoring --setuser ceph since I am not root 2024-09-19T07:25:31.225 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:25:30 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b[63680]: ignoring --setgroup ceph since I am not root 2024-09-19T07:25:31.225 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:25:30 smithi046 ceph-mds[63684]: -- 172.21.15.46:0/2485166186 <== mon.1 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f51cabd860 con 0x55f51ca9a800 2024-09-19T07:25:31.225 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:25:30 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b[63680]: starting mds.b at 2024-09-19T07:25:31.246 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:30 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a[31251]: 2024-09-19T07:25:30.904+0000 7fea72551640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:25:31.378 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:25:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: ignoring --setuser ceph since I am not root 2024-09-19T07:25:31.378 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:25:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: ignoring --setgroup ceph since I am not root 2024-09-19T07:25:31.378 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:25:30 smithi078 ceph-mds[65185]: -- 172.21.15.78:0/2030427036 <== mon.1 v2:172.21.15.78:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563730755c20 con 0x563730732800 2024-09-19T07:25:31.378 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:25:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: starting mds.i at 2024-09-19T07:25:31.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-19T07:25:31.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1925327985' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:25:31.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:25:31.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:25:31.569 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1925327985' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:25:31.570 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T07:25:31.570 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:31 smithi029 ceph-mon[31255]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T07:25:31.602 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T07:25:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-19T07:25:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1925327985' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:25:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:25:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:25:31.695 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1925327985' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:25:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T07:25:31.696 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:31 smithi078 ceph-mon[34556]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: pgmap v870: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 3.2 KiB/s wr, 2 op/s 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1925327985' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1925327985' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T07:25:31.725 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:31 smithi046 ceph-mon[34147]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T07:25:31.866 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:32.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 -- 172.21.15.29:0/4177552197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 msgr2=0x7f437410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 --2- 172.21.15.29:0/4177552197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f437410d950 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f436c009cd0 tx=0x7f436c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 -- 172.21.15.29:0/4177552197 shutdown_connections 2024-09-19T07:25:32.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 --2- 172.21.15.29:0/4177552197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f437410d950 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 --2- 172.21.15.29:0/4177552197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4374100a80 0x7f4374100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 --2- 172.21.15.29:0/4177552197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4374106a80 0x7f4374106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 -- 172.21.15.29:0/4177552197 >> 172.21.15.29:0/4177552197 conn(0x7f43740fc7a0 msgr2=0x7f43740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:32.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 -- 172.21.15.29:0/4177552197 shutdown_connections 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.380+0000 7f4379157640 1 -- 172.21.15.29:0/4177552197 wait complete. 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 Processor -- start 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 -- start start 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4374100a80 0x7f4374198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f4374198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4374106a80 0x7f437419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f4374110d80 con 0x7f4374101420 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4374110c00 con 0x7f4374100a80 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4379157640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4374110f00 con 0x7f4374106a80 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f437259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f4374198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f437259c640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f4374198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50790/0 (socket says 172.21.15.29:50790) 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f437259c640 1 -- 172.21.15.29:0/2468144965 learned_addr learned my addr 172.21.15.29:0/2468144965 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:32.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.381+0000 7f4372d9d640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4374100a80 0x7f4374198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437359e640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4374106a80 0x7f437419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437259c640 1 -- 172.21.15.29:0/2468144965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4374106a80 msgr2=0x7f437419cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437259c640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4374106a80 0x7f437419cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437259c640 1 -- 172.21.15.29:0/2468144965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4374100a80 msgr2=0x7f4374198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437259c640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4374100a80 0x7f4374198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437259c640 1 -- 172.21.15.29:0/2468144965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437419d2b0 con 0x7f4374101420 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f437259c640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f4374198840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f436800c890 tx=0x7f436800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368004220 con 0x7f4374101420 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f43680043c0 con 0x7f4374101420 2024-09-19T07:25:32.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437419d5a0 con 0x7f4374101420 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4368004a00 con 0x7f4374101420 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.382+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43741a4e80 con 0x7f4374101420 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.383+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4374100ee0 con 0x7f4374101420 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.384+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f43680079b0 con 0x7f4374101420 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.385+0000 7f435bfff640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f435c0a3240 0x7f435c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.385+0000 7f4372d9d640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f435c0a3240 0x7f435c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.385+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9236+0+0 (secure 0 0 0) 0x7f43680cfa30 con 0x7f4374101420 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.386+0000 7f4372d9d640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f435c0a3240 0x7f435c0a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f436400ab60 tx=0x7f436400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.389+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4368014030 con 0x7f4374101420 2024-09-19T07:25:32.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.603+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f43741a50e0 con 0x7f4374101420 2024-09-19T07:25:32.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.912+0000 7f435bfff640 1 -- 172.21.15.29:0/2468144965 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f436809c300 con 0x7f4374101420 2024-09-19T07:25:32.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f435c0a3240 msgr2=0x7f435c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f435c0a3240 0x7f435c0a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f436400ab60 tx=0x7f436400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 msgr2=0x7f4374198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f4374198840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f436800c890 tx=0x7f436800cc90 comp rx=0 tx=0).stop 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 shutdown_connections 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f435c0a3240 0x7f435c0a5700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4374106a80 0x7f437419cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4374101420 0x7f4374198840 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 --2- 172.21.15.29:0/2468144965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4374100a80 0x7f4374198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 >> 172.21.15.29:0/2468144965 conn(0x7f43740fc7a0 msgr2=0x7f437406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 shutdown_connections 2024-09-19T07:25:32.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:32.915+0000 7f4379157640 1 -- 172.21.15.29:0/2468144965 wait complete. 2024-09-19T07:25:33.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:32 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.78:6838/1215577483,v1:172.21.15.78:6839/1215577483] up:boot 2024-09-19T07:25:33.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:32 smithi078 ceph-mon[34556]: mds.? [v2:172.21.15.46:6838/2988211940,v1:172.21.15.46:6839/2988211940] up:boot 2024-09-19T07:25:33.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:32 smithi078 ceph-mon[34556]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T07:25:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:25:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:32 smithi078 ceph-mon[34556]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:25:33.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:32 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2468144965' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:25:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:32 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.78:6838/1215577483,v1:172.21.15.78:6839/1215577483] up:boot 2024-09-19T07:25:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:32 smithi029 ceph-mon[31255]: mds.? [v2:172.21.15.46:6838/2988211940,v1:172.21.15.46:6839/2988211940] up:boot 2024-09-19T07:25:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:32 smithi029 ceph-mon[31255]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T07:25:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:25:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:32 smithi029 ceph-mon[31255]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:25:33.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:32 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2468144965' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:25:33.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:32 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.78:6838/1215577483,v1:172.21.15.78:6839/1215577483] up:boot 2024-09-19T07:25:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:32 smithi046 ceph-mon[34147]: mds.? [v2:172.21.15.46:6838/2988211940,v1:172.21.15.46:6839/2988211940] up:boot 2024-09-19T07:25:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:32 smithi046 ceph-mon[34147]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T07:25:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:25:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:32 smithi046 ceph-mon[34147]: from='mgr.14150 172.21.15.29:0/2762605681' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:25:33.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:32 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2468144965' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:25:33.646 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T07:25:33.912 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:33 smithi078 ceph-mon[34556]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-19T07:25:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:33 smithi078 ceph-mon[34556]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:25:34.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:33 smithi078 ceph-mon[34556]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:25:34.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:33 smithi078 ceph-mon[34556]: Cluster is now healthy 2024-09-19T07:25:34.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:33 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2468144965' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:25:34.196 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:33 smithi078 ceph-mon[34556]: fsmap 12 up:standby 2024-09-19T07:25:34.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:33 smithi046 ceph-mon[34147]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-19T07:25:34.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:33 smithi046 ceph-mon[34147]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:25:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:33 smithi046 ceph-mon[34147]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:25:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:33 smithi046 ceph-mon[34147]: Cluster is now healthy 2024-09-19T07:25:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:33 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2468144965' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:25:34.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:33 smithi046 ceph-mon[34147]: fsmap 12 up:standby 2024-09-19T07:25:34.235 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:33 smithi029 ceph-mon[31255]: pgmap v872: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-19T07:25:34.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:33 smithi029 ceph-mon[31255]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:25:34.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:33 smithi029 ceph-mon[31255]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:25:34.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:33 smithi029 ceph-mon[31255]: Cluster is now healthy 2024-09-19T07:25:34.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:33 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2468144965' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:25:34.236 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:33 smithi029 ceph-mon[31255]: fsmap 12 up:standby 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 -- 172.21.15.29:0/3470786992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac101de0 msgr2=0x7faeac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 --2- 172.21.15.29:0/3470786992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac101de0 0x7faeac1021c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faea0009900 tx=0x7faea002a410 comp rx=0 tx=0).stop 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 -- 172.21.15.29:0/3470786992 shutdown_connections 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 --2- 172.21.15.29:0/3470786992 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faeac106f10 0x7faeac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 --2- 172.21.15.29:0/3470786992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faeac102790 0x7faeac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 --2- 172.21.15.29:0/3470786992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac101de0 0x7faeac1021c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 -- 172.21.15.29:0/3470786992 >> 172.21.15.29:0/3470786992 conn(0x7faeac0fd8c0 msgr2=0x7faeac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 -- 172.21.15.29:0/3470786992 shutdown_connections 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.511+0000 7faeb4421640 1 -- 172.21.15.29:0/3470786992 wait complete. 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 Processor -- start 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 -- start start 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faeac101de0 0x7faeac1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faeac102790 0x7faeac198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 0x7faeac19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111e60 con 0x7faeac106f10 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111ce0 con 0x7faeac101de0 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb4421640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faeac111fe0 con 0x7faeac102790 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb29be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 0x7faeac19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb29be640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 0x7faeac19ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50808/0 (socket says 172.21.15.29:50808) 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.512+0000 7faeb29be640 1 -- 172.21.15.29:0/2204199515 learned_addr learned my addr 172.21.15.29:0/2204199515 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:34.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb19bc640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faeac102790 0x7faeac198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb21bd640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faeac101de0 0x7faeac1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb29be640 1 -- 172.21.15.29:0/2204199515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faeac102790 msgr2=0x7faeac198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb29be640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faeac102790 0x7faeac198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb29be640 1 -- 172.21.15.29:0/2204199515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faeac101de0 msgr2=0x7faeac1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb29be640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faeac101de0 0x7faeac1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb29be640 1 -- 172.21.15.29:0/2204199515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeac19d390 con 0x7faeac106f10 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb29be640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 0x7faeac19ccb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faea400b970 tx=0x7faea400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4019070 con 0x7faeac106f10 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faea4014440 con 0x7faeac106f10 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeac19d680 con 0x7faeac106f10 2024-09-19T07:25:34.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea40075d0 con 0x7faeac106f10 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.513+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeac1a4f60 con 0x7faeac106f10 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.514+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeac1021c0 con 0x7faeac106f10 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.515+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7faea401c070 con 0x7faeac106f10 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.516+0000 7fae9f7fe640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fae980a3240 0x7fae980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.516+0000 7faeb21bd640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fae980a3240 0x7fae980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.516+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9236+0+0 (secure 0 0 0) 0x7faea40cf330 con 0x7faeac106f10 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.517+0000 7faeb21bd640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fae980a3240 0x7fae980a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faea0031440 tx=0x7faea00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:34.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.520+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faea409b5b0 con 0x7faeac106f10 2024-09-19T07:25:34.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.700+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7faeac10a0f0 con 0x7faeac106f10 2024-09-19T07:25:34.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.921+0000 7fae9f7fe640 1 -- 172.21.15.29:0/2204199515 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7faea409f8b0 con 0x7faeac106f10 2024-09-19T07:25:34.922 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_metadata' removed 2024-09-19T07:25:34.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fae980a3240 msgr2=0x7fae980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:34.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fae980a3240 0x7fae980a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7faea0031440 tx=0x7faea00095f0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 msgr2=0x7faeac19ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:34.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 0x7faeac19ccb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faea400b970 tx=0x7faea400be30 comp rx=0 tx=0).stop 2024-09-19T07:25:34.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 shutdown_connections 2024-09-19T07:25:34.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faeac106f10 0x7faeac19ccb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fae980a3240 0x7fae980a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faeac102790 0x7faeac198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 --2- 172.21.15.29:0/2204199515 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faeac101de0 0x7faeac1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:34.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.925+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 >> 172.21.15.29:0/2204199515 conn(0x7faeac0fd8c0 msgr2=0x7faeac0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:34.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.926+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 shutdown_connections 2024-09-19T07:25:34.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:34.926+0000 7faeb4421640 1 -- 172.21.15.29:0/2204199515 wait complete. 2024-09-19T07:25:35.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:34 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2204199515' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:35.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:34 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2204199515' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:35.301 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:34 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2204199515' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:35.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T07:25:35.942 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:35 smithi078 ceph-mon[34556]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T07:25:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:35 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2204199515' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:36.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:35 smithi078 ceph-mon[34556]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T07:25:36.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:35 smithi029 ceph-mon[31255]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T07:25:36.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:35 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2204199515' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:36.206 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:35 smithi029 ceph-mon[31255]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T07:25:36.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:35 smithi046 ceph-mon[34147]: pgmap v873: 129 pgs: 129 active+clean; 1.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 2 op/s 2024-09-19T07:25:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:35 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2204199515' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:36.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:35 smithi046 ceph-mon[34147]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T07:25:36.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 -- 172.21.15.29:0/2789182028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c103700 msgr2=0x7f696c10bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:36.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 --2- 172.21.15.29:0/2789182028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c103700 0x7f696c10bbf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6960009900 tx=0x7f696002a480 comp rx=0 tx=0).stop 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 -- 172.21.15.29:0/2789182028 shutdown_connections 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 --2- 172.21.15.29:0/2789182028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c10c180 0x7f696c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 --2- 172.21.15.29:0/2789182028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c103700 0x7f696c10bbf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 --2- 172.21.15.29:0/2789182028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f696c102de0 0x7f696c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 -- 172.21.15.29:0/2789182028 >> 172.21.15.29:0/2789182028 conn(0x7f696c0fc7a0 msgr2=0x7f696c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 -- 172.21.15.29:0/2789182028 shutdown_connections 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.441+0000 7f697248b640 1 -- 172.21.15.29:0/2789182028 wait complete. 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 Processor -- start 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 -- start start 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c102de0 0x7f696c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f696c103700 0x7f696c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:36.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 0x7f696c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7f696c111e20 con 0x7f696c10c180 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f696c111ca0 con 0x7f696c103700 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f697248b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f696c111fa0 con 0x7f696c102de0 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f6970a28640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 0x7f696c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f6970a28640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 0x7f696c19cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50156/0 (socket says 172.21.15.29:50156) 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f6970a28640 1 -- 172.21.15.29:0/1322587178 learned_addr learned my addr 172.21.15.29:0/1322587178 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f696b7fe640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f696c103700 0x7f696c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.442+0000 7f696bfff640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c102de0 0x7f696c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f6970a28640 1 -- 172.21.15.29:0/1322587178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c102de0 msgr2=0x7f696c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:36.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f6970a28640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c102de0 0x7f696c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f6970a28640 1 -- 172.21.15.29:0/1322587178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f696c103700 msgr2=0x7f696c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f6970a28640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f696c103700 0x7f696c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f6970a28640 1 -- 172.21.15.29:0/1322587178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c19d2f0 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f696bfff640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c102de0 0x7f696c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f6970a28640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 0x7f696c19cc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f696400cce0 tx=0x7f696400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696400f450 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f696400faa0 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c19d5e0 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964018b70 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.443+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c1a4ec0 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.444+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c1031c0 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.446+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6964018d10 con 0x7f696c10c180 2024-09-19T07:25:36.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.447+0000 7f69697fa640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f69540a3240 0x7f69540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:36.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.447+0000 7f696bfff640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f69540a3240 0x7f69540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:36.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.447+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8653+0+0 (secure 0 0 0) 0x7f69640cff90 con 0x7f696c10c180 2024-09-19T07:25:36.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.447+0000 7f696bfff640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f69540a3240 0x7f69540a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f695c00baa0 tx=0x7f695c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:36.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.450+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6964014030 con 0x7f696c10c180 2024-09-19T07:25:36.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.627+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f696c1996a0 con 0x7f696c10c180 2024-09-19T07:25:36.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.928+0000 7f69697fa640 1 -- 172.21.15.29:0/1322587178 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7f696409cba0 con 0x7f696c10c180 2024-09-19T07:25:36.929 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data' removed 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.931+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f69540a3240 msgr2=0x7f69540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.931+0000 7f697248b640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f69540a3240 0x7f69540a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f695c00baa0 tx=0x7f695c005d90 comp rx=0 tx=0).stop 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.931+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 msgr2=0x7f696c19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.931+0000 7f697248b640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 0x7f696c19cc10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f696400cce0 tx=0x7f696400a620 comp rx=0 tx=0).stop 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 shutdown_connections 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f696c10c180 0x7f696c19cc10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f696c103700 0x7f696c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7f69540a3240 0x7f69540a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 --2- 172.21.15.29:0/1322587178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f696c102de0 0x7f696c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 >> 172.21.15.29:0/1322587178 conn(0x7f696c0fc7a0 msgr2=0x7f696c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 shutdown_connections 2024-09-19T07:25:36.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:36.932+0000 7f697248b640 1 -- 172.21.15.29:0/1322587178 wait complete. 2024-09-19T07:25:37.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:36 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1322587178' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:37.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:36 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1322587178' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:37.263 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:36 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1322587178' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:37.641 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 6a046fca-7654-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T07:25:37.901 INFO:teuthology.orchestra.run.smithi029.stderr:Inferring config /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:38.186 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:37 smithi029 ceph-mon[31255]: pgmap v875: 97 pgs: 97 active+clean; 1.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:25:38.186 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:37 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/1322587178' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:38.186 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:37 smithi029 ceph-mon[31255]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T07:25:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:37 smithi078 ceph-mon[34556]: pgmap v875: 97 pgs: 97 active+clean; 1.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:25:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:37 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/1322587178' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:38.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:37 smithi078 ceph-mon[34556]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T07:25:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:37 smithi046 ceph-mon[34147]: pgmap v875: 97 pgs: 97 active+clean; 1.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:25:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:37 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/1322587178' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:38.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:37 smithi046 ceph-mon[34147]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T07:25:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 -- 172.21.15.29:0/1679367043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20102790 msgr2=0x7fef201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 --2- 172.21.15.29:0/1679367043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20102790 0x7fef201067e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fef08009900 tx=0x7fef0802a410 comp rx=0 tx=0).stop 2024-09-19T07:25:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 -- 172.21.15.29:0/1679367043 shutdown_connections 2024-09-19T07:25:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 --2- 172.21.15.29:0/1679367043 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef20106f10 0x7fef2010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 --2- 172.21.15.29:0/1679367043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20102790 0x7fef201067e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 --2- 172.21.15.29:0/1679367043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20101de0 0x7fef201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 -- 172.21.15.29:0/1679367043 >> 172.21.15.29:0/1679367043 conn(0x7fef200fd8c0 msgr2=0x7fef200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 -- 172.21.15.29:0/1679367043 shutdown_connections 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.419+0000 7fef26a59640 1 -- 172.21.15.29:0/1679367043 wait complete. 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 Processor -- start 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 -- start start 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 0x7fef20198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef20102790 0x7fef20198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20106f10 0x7fef2019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 -- 0x7fef20111eb0 con 0x7fef20101de0 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef20111d30 con 0x7fef20102790 2024-09-19T07:25:38.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef26a59640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef20112030 con 0x7fef20106f10 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 0x7fef20198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 0x7fef20198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:50164/0 (socket says 172.21.15.29:50164) 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 -- 172.21.15.29:0/2662265520 learned_addr learned my addr 172.21.15.29:0/2662265520 (peer_addr_for_me v2:172.21.15.29:0/0) 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef24ff6640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20106f10 0x7fef2019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 -- 172.21.15.29:0/2662265520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20106f10 msgr2=0x7fef2019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20106f10 0x7fef2019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 -- 172.21.15.29:0/2662265520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef20102790 msgr2=0x7fef20198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef20102790 0x7fef20198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef1ffff640 1 -- 172.21.15.29:0/2662265520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2019d3e0 con 0x7fef20101de0 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.420+0000 7fef24ff6640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20106f10 0x7fef2019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.421+0000 7fef1ffff640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 0x7fef20198430 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef1000d770 tx=0x7fef1000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.421+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10017070 con 0x7fef20101de0 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.421+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fef100054d0 con 0x7fef20101de0 2024-09-19T07:25:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.421+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2019d6d0 con 0x7fef20101de0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.421+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10004cf0 con 0x7fef20101de0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.421+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef201a4fb0 con 0x7fef20101de0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.422+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef201021c0 con 0x7fef20101de0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.423+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef10004e90 con 0x7fef20101de0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.424+0000 7fef1dffb640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fef0c0a32c0 0x7fef0c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.424+0000 7fef17fff640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fef0c0a32c0 0x7fef0c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.424+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8152+0+0 (secure 0 0 0) 0x7fef100cf310 con 0x7fef20101de0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.424+0000 7fef17fff640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fef0c0a32c0 0x7fef0c0a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fef0802a930 tx=0x7fef08031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.428+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef1009c0d0 con 0x7fef20101de0 2024-09-19T07:25:38.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.608+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fef20199790 con 0x7fef20101de0 2024-09-19T07:25:38.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.934+0000 7fef1dffb640 1 -- 172.21.15.29:0/2662265520 <== mon.0 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v96) ==== 178+0+0 (secure 0 0 0) 0x7fef1009b9d0 con 0x7fef20101de0 2024-09-19T07:25:38.935 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'cephfs_data_ec' removed 2024-09-19T07:25:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fef0c0a32c0 msgr2=0x7fef0c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fef0c0a32c0 0x7fef0c0a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fef0802a930 tx=0x7fef08031400 comp rx=0 tx=0).stop 2024-09-19T07:25:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 msgr2=0x7fef20198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 0x7fef20198430 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef1000d770 tx=0x7fef1000dc30 comp rx=0 tx=0).stop 2024-09-19T07:25:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 shutdown_connections 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:6800/3056547780,v1:172.21.15.29:6801/3056547780] conn(0x7fef0c0a32c0 0x7fef0c0a5780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef20106f10 0x7fef2019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef20102790 0x7fef20198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 --2- 172.21.15.29:0/2662265520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef20101de0 0x7fef20198430 secure :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fef1000d770 tx=0x7fef1000dc30 comp rx=0 tx=0).stop 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.938+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 >> 172.21.15.29:0/2662265520 conn(0x7fef200fd8c0 msgr2=0x7fef200fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.939+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 shutdown_connections 2024-09-19T07:25:38.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-19T07:25:38.939+0000 7fef26a59640 1 -- 172.21.15.29:0/2662265520 wait complete. 2024-09-19T07:25:39.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:38 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2662265520' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:39.224 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:38 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2662265520' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:39.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:38 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2662265520' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:25:39.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:25:40.070 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:25:40.189 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:25:40.189 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:39 smithi046 ceph-mon[34147]: pgmap v877: 33 pgs: 33 active+clean; 1.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:25:40.189 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:39 smithi046 ceph-mon[34147]: from='client.? 172.21.15.29:0/2662265520' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:40.189 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:39 smithi046 ceph-mon[34147]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T07:25:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:39 smithi078 ceph-mon[34556]: pgmap v877: 33 pgs: 33 active+clean; 1.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:25:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:39 smithi078 ceph-mon[34556]: from='client.? 172.21.15.29:0/2662265520' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:40.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:39 smithi078 ceph-mon[34556]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T07:25:40.293 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T07:25:40.293 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:25:40.322 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:25:40.355 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:25:40.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:39 smithi029 ceph-mon[31255]: pgmap v877: 33 pgs: 33 active+clean; 1.4 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:25:40.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:39 smithi029 ceph-mon[31255]: from='client.? 172.21.15.29:0/2662265520' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:25:40.373 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:39 smithi029 ceph-mon[31255]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T07:25:40.439 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T07:25:40.439 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T07:25:40.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a 2024-09-19T07:25:40.763 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:40 smithi029 systemd[1]: Stopping Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:41.123 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a[31251]: 2024-09-19T07:25:40.762+0000 7fea77d5c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:25:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a[31251]: 2024-09-19T07:25:40.762+0000 7fea77d5c640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T07:25:41.124 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:40 smithi029 podman[95174]: 2024-09-19 07:25:40.824239516 +0000 UTC m=+0.184257794 container died ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:25:41.528 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:41 smithi029 podman[95174]: 2024-09-19 07:25:41.250770378 +0000 UTC m=+0.610788644 container cleanup ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:25:41.529 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:41 smithi029 bash[95174]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a 2024-09-19T07:25:41.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T07:25:41.781 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:41 smithi029 podman[95186]: 2024-09-19 07:25:41.529056537 +0000 UTC m=+0.703092480 container remove ac4d29aa573349513f8c662176c63e817d0feb6bb321175e92a47392b9cefe7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:25:41.781 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:41 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T07:25:41.781 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:41 smithi029 systemd[1]: Stopped Ceph mon.a for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:25:41.781 INFO:journalctl@ceph.mon.a.smithi029.stdout:Sep 19 07:25:41 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.a.service: Consumed 25.991s CPU time. 2024-09-19T07:25:41.825 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:41.825 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T07:25:41.825 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T07:25:41.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.b 2024-09-19T07:25:42.164 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:41 smithi046 systemd[1]: Stopping Ceph mon.b for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-b[34143]: 2024-09-19T07:25:42.164+0000 7f3c8a024640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:25:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-b[34143]: 2024-09-19T07:25:42.164+0000 7f3c8a024640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:25:42.475 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:42 smithi046 podman[68530]: 2024-09-19 07:25:42.348503108 +0000 UTC m=+0.302665051 container died 424df4c342da12eb74c67fc1cfc44b02d60e962f4f82aac89c4cfe318030bcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:25:43.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:42 smithi046 podman[68530]: 2024-09-19 07:25:42.973069773 +0000 UTC m=+0.927231705 container cleanup 424df4c342da12eb74c67fc1cfc44b02d60e962f4f82aac89c4cfe318030bcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T07:25:43.225 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:42 smithi046 bash[68530]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-b 2024-09-19T07:25:43.480 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T07:25:43.502 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:43 smithi046 podman[68541]: 2024-09-19 07:25:43.241448635 +0000 UTC m=+0.885326356 container remove 424df4c342da12eb74c67fc1cfc44b02d60e962f4f82aac89c4cfe318030bcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:25:43.502 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:43 smithi046 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T07:25:43.502 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:43 smithi046 systemd[1]: Stopped Ceph mon.b for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:25:43.502 INFO:journalctl@ceph.mon.b.smithi046.stdout:Sep 19 07:25:43 smithi046 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.b.service: Consumed 13.435s CPU time. 2024-09-19T07:25:43.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:43.534 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T07:25:43.534 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T07:25:43.534 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.c 2024-09-19T07:25:43.945 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:43 smithi078 systemd[1]: Stopping Ceph mon.c for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:44.556 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-c[34548]: 2024-09-19T07:25:44.289+0000 7ff07022c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:25:44.556 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-c[34548]: 2024-09-19T07:25:44.289+0000 7ff07022c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:25:44.875 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:44 smithi078 podman[69735]: 2024-09-19 07:25:44.556225971 +0000 UTC m=+0.613465823 container died 12de75059fc143432e584a999f3337851bea24d8ec349963781bf7d3e85c7a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T07:25:45.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:45 smithi078 podman[69735]: 2024-09-19 07:25:45.090676774 +0000 UTC m=+1.147916628 container cleanup 12de75059fc143432e584a999f3337851bea24d8ec349963781bf7d3e85c7a82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T07:25:45.195 INFO:journalctl@ceph.mon.c.smithi078.stdout:Sep 19 07:25:45 smithi078 bash[69735]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mon-c 2024-09-19T07:25:45.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T07:25:45.631 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:45.632 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T07:25:45.632 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T07:25:45.632 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x 2024-09-19T07:25:46.123 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:45 smithi029 systemd[1]: Stopping Ceph mgr.x for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:46.623 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x[31482]: 2024-09-19T07:25:46.361+0000 7fa4540fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:25:46.624 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:46 smithi029 podman[95294]: 2024-09-19 07:25:46.403002146 +0000 UTC m=+0.564494830 container died 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T07:25:47.373 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:47 smithi029 podman[95294]: 2024-09-19 07:25:47.13330158 +0000 UTC m=+1.294794250 container cleanup 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:25:47.374 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:47 smithi029 bash[95294]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x 2024-09-19T07:25:47.623 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T07:25:47.646 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:47 smithi029 podman[95308]: 2024-09-19 07:25:47.395024559 +0000 UTC m=+0.992407923 container remove 0c441debf022271685ea58fdc134f41deb20e4bbd75c5b3816830298889db8ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:25:47.646 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:47 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-19T07:25:47.646 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:47 smithi029 systemd[1]: Stopped Ceph mgr.x for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:25:47.646 INFO:journalctl@ceph.mgr.x.smithi029.stdout:Sep 19 07:25:47 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.x.service: Consumed 54.212s CPU time. 2024-09-19T07:25:47.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:47.660 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T07:25:47.661 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T07:25:47.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.y 2024-09-19T07:25:47.975 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:25:47 smithi046 systemd[1]: Stopping Ceph mgr.y for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:48.321 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:25:48 smithi046 podman[68654]: 2024-09-19 07:25:48.007248484 +0000 UTC m=+0.148175129 container died 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T07:25:48.713 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:25:48 smithi046 podman[68654]: 2024-09-19 07:25:48.449004935 +0000 UTC m=+0.589931581 container cleanup 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T07:25:48.713 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:25:48 smithi046 bash[68654]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y 2024-09-19T07:25:48.975 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:25:48 smithi046 podman[68667]: 2024-09-19 07:25:48.713691569 +0000 UTC m=+0.696713863 container remove 6432a7a6206a676c3bb119b8fa2b2b693e93561a2900f8ea86b26e8d63efdb40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:25:48.975 INFO:journalctl@ceph.mgr.y.smithi046.stdout:Sep 19 07:25:48 smithi046 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T07:25:49.027 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T07:25:49.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:49.065 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T07:25:49.065 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T07:25:49.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.z 2024-09-19T07:25:49.445 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:25:49 smithi078 systemd[1]: Stopping Ceph mgr.z for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:49.797 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:25:49 smithi078 podman[69860]: 2024-09-19 07:25:49.476155664 +0000 UTC m=+0.215315303 container died 7c2cf35a47b3bc0116bc02e798fc6694b90d5d86ecb8fad21ea5cb69abf00d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T07:25:50.140 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:25:49 smithi078 podman[69860]: 2024-09-19 07:25:49.896776375 +0000 UTC m=+0.635936009 container cleanup 7c2cf35a47b3bc0116bc02e798fc6694b90d5d86ecb8fad21ea5cb69abf00d0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T07:25:50.140 INFO:journalctl@ceph.mgr.z.smithi078.stdout:Sep 19 07:25:49 smithi078 bash[69860]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mgr-z 2024-09-19T07:25:50.352 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T07:25:50.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:50.387 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T07:25:50.387 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T07:25:50.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.0 2024-09-19T07:25:50.708 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:50 smithi029 systemd[1]: Stopping Ceph osd.0 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:51.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0[45083]: 2024-09-19T07:25:50.706+0000 7f0cdc76b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:25:51.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0[45083]: 2024-09-19T07:25:50.706+0000 7f0cdc76b640 -1 osd.0 96 *** Got signal Terminated *** 2024-09-19T07:25:51.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0[45083]: 2024-09-19T07:25:50.706+0000 7f0cdc76b640 -1 osd.0 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:25:56.623 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:56 smithi029 podman[95416]: 2024-09-19 07:25:56.182930273 +0000 UTC m=+5.600780419 container died 5ec009f7abbfdcf73fb0447b0e773925b0fcc91f31214ef6a885cc2e5847c48f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:25:57.373 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:57 smithi029 podman[95416]: 2024-09-19 07:25:57.164478267 +0000 UTC m=+6.582328400 container cleanup 5ec009f7abbfdcf73fb0447b0e773925b0fcc91f31214ef6a885cc2e5847c48f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T07:25:57.374 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:57 smithi029 bash[95416]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0 2024-09-19T07:25:57.812 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:57 smithi029 podman[95433]: 2024-09-19 07:25:57.494203043 +0000 UTC m=+1.301170020 container remove 5ec009f7abbfdcf73fb0447b0e773925b0fcc91f31214ef6a885cc2e5847c48f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T07:25:58.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:57 smithi029 podman[95521]: 2024-09-19 07:25:57.715494516 +0000 UTC m=+0.016939085 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:25:58.124 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:57 smithi029 podman[95521]: 2024-09-19 07:25:57.837696789 +0000 UTC m=+0.139141390 container create 3c332f7d8334e0f064a141e5a000f0afecad62b21426508723702cda416ca290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T07:25:58.402 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:58 smithi029 podman[95521]: 2024-09-19 07:25:58.125626907 +0000 UTC m=+0.427071475 container init 3c332f7d8334e0f064a141e5a000f0afecad62b21426508723702cda416ca290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T07:25:58.402 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:58 smithi029 podman[95521]: 2024-09-19 07:25:58.129327792 +0000 UTC m=+0.430772353 container start 3c332f7d8334e0f064a141e5a000f0afecad62b21426508723702cda416ca290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T07:25:58.402 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:58 smithi029 podman[95521]: 2024-09-19 07:25:58.278425034 +0000 UTC m=+0.579869609 container attach 3c332f7d8334e0f064a141e5a000f0afecad62b21426508723702cda416ca290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:25:58.873 INFO:journalctl@ceph.osd.0.smithi029.stdout:Sep 19 07:25:58 smithi029 podman[95521]: 2024-09-19 07:25:58.571796341 +0000 UTC m=+0.873240900 container died 3c332f7d8334e0f064a141e5a000f0afecad62b21426508723702cda416ca290 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T07:25:59.195 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T07:25:59.235 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:25:59.235 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T07:25:59.235 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T07:25:59.236 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.1 2024-09-19T07:25:59.567 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:25:59 smithi046 systemd[1]: Stopping Ceph osd.1 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:25:59.975 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:25:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1[38609]: 2024-09-19T07:25:59.566+0000 7f76b45d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:25:59.975 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:25:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1[38609]: 2024-09-19T07:25:59.566+0000 7f76b45d4640 -1 osd.1 96 *** Got signal Terminated *** 2024-09-19T07:25:59.975 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:25:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1[38609]: 2024-09-19T07:25:59.566+0000 7f76b45d4640 -1 osd.1 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:05.395 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:05 smithi046 podman[68779]: 2024-09-19 07:26:05.138439088 +0000 UTC m=+5.702463865 container died be241a66afb461b00bf0294226366148561c5bbc9ed20baa990e4f2fa9ed9155 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:26:06.080 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:05 smithi046 podman[68779]: 2024-09-19 07:26:05.767621123 +0000 UTC m=+6.331645892 container cleanup be241a66afb461b00bf0294226366148561c5bbc9ed20baa990e4f2fa9ed9155 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:06.080 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:05 smithi046 bash[68779]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1 2024-09-19T07:26:06.475 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:06 smithi046 podman[68794]: 2024-09-19 07:26:06.077404501 +0000 UTC m=+0.934919627 container remove be241a66afb461b00bf0294226366148561c5bbc9ed20baa990e4f2fa9ed9155 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T07:26:06.822 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:06 smithi046 podman[68884]: 2024-09-19 07:26:06.427368659 +0000 UTC m=+0.016658397 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:06.823 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:06 smithi046 podman[68884]: 2024-09-19 07:26:06.570125389 +0000 UTC m=+0.159415158 container create b611963d75fd26e7f074ee7c7bf3e0148bd50efb9d450b2081b3e0159131adc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:26:07.225 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:06 smithi046 podman[68884]: 2024-09-19 07:26:06.822894016 +0000 UTC m=+0.412183751 container init b611963d75fd26e7f074ee7c7bf3e0148bd50efb9d450b2081b3e0159131adc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:07.226 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:06 smithi046 podman[68884]: 2024-09-19 07:26:06.826609334 +0000 UTC m=+0.415899062 container start b611963d75fd26e7f074ee7c7bf3e0148bd50efb9d450b2081b3e0159131adc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:26:07.226 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:06 smithi046 podman[68884]: 2024-09-19 07:26:06.956118848 +0000 UTC m=+0.545408575 container attach b611963d75fd26e7f074ee7c7bf3e0148bd50efb9d450b2081b3e0159131adc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:07.226 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 19 07:26:07 smithi046 podman[68884]: 2024-09-19 07:26:07.050000321 +0000 UTC m=+0.639290056 container died b611963d75fd26e7f074ee7c7bf3e0148bd50efb9d450b2081b3e0159131adc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:07.988 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T07:26:08.034 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:08.034 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T07:26:08.034 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T07:26:08.034 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.2 2024-09-19T07:26:08.377 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:08 smithi078 systemd[1]: Stopping Ceph osd.2 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:08.695 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2[39547]: 2024-09-19T07:26:08.375+0000 7f59ff624640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:08.695 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2[39547]: 2024-09-19T07:26:08.375+0000 7f59ff624640 -1 osd.2 96 *** Got signal Terminated *** 2024-09-19T07:26:08.696 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2[39547]: 2024-09-19T07:26:08.375+0000 7f59ff624640 -1 osd.2 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:14.388 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:14 smithi078 podman[70000]: 2024-09-19 07:26:14.030988542 +0000 UTC m=+5.785908173 container died 06f300a562647f68df87c24375ca571cb481b1b13f8af55dbc26a0a4bd4713a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T07:26:14.694 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:14 smithi078 podman[70000]: 2024-09-19 07:26:14.459969288 +0000 UTC m=+6.214888922 container cleanup 06f300a562647f68df87c24375ca571cb481b1b13f8af55dbc26a0a4bd4713a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T07:26:14.695 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:14 smithi078 bash[70000]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2 2024-09-19T07:26:14.948 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:14 smithi078 podman[70016]: 2024-09-19 07:26:14.694879991 +0000 UTC m=+0.650594578 container remove 06f300a562647f68df87c24375ca571cb481b1b13f8af55dbc26a0a4bd4713a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:15.420 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:15 smithi078 podman[70105]: 2024-09-19 07:26:15.019154823 +0000 UTC m=+0.016564609 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:15.420 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:15 smithi078 podman[70105]: 2024-09-19 07:26:15.304457857 +0000 UTC m=+0.301867675 container create d03964353409e5711ef91e9e8e94d01bf39183296aa0bf41b9345559b25ad55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:15.674 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:15 smithi078 podman[70105]: 2024-09-19 07:26:15.574078688 +0000 UTC m=+0.571488474 container init d03964353409e5711ef91e9e8e94d01bf39183296aa0bf41b9345559b25ad55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T07:26:15.674 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:15 smithi078 podman[70105]: 2024-09-19 07:26:15.577586941 +0000 UTC m=+0.574996726 container start d03964353409e5711ef91e9e8e94d01bf39183296aa0bf41b9345559b25ad55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T07:26:15.945 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:15 smithi078 podman[70105]: 2024-09-19 07:26:15.674123629 +0000 UTC m=+0.671533418 container attach d03964353409e5711ef91e9e8e94d01bf39183296aa0bf41b9345559b25ad55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T07:26:15.945 INFO:journalctl@ceph.osd.2.smithi078.stdout:Sep 19 07:26:15 smithi078 podman[70105]: 2024-09-19 07:26:15.801189701 +0000 UTC m=+0.798599479 container died d03964353409e5711ef91e9e8e94d01bf39183296aa0bf41b9345559b25ad55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T07:26:16.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T07:26:16.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:16.459 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T07:26:16.459 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T07:26:16.459 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.3 2024-09-19T07:26:16.786 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:16 smithi029 systemd[1]: Stopping Ceph osd.3 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:17.123 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:16.785+0000 7ff623611640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:17.123 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:16.785+0000 7ff623611640 -1 osd.3 96 *** Got signal Terminated *** 2024-09-19T07:26:17.124 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:16 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:16.785+0000 7ff623611640 -1 osd.3 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:17.975 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:17.555+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:18.623 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:18 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:18.282+0000 7ff61bc1f640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:54.698982+0000 front 2024-09-19T07:25:54.699043+0000 (oldest deadline 2024-09-19T07:26:17.599109+0000) 2024-09-19T07:26:18.624 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:18 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:18.253+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:18.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:18.545+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:19.623 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:19 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:19.326+0000 7ff61bc1f640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:54.698982+0000 front 2024-09-19T07:25:54.699043+0000 (oldest deadline 2024-09-19T07:26:17.599109+0000) 2024-09-19T07:26:19.624 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:19 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:19.263+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:19.975 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:19.526+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:20.623 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:20 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:20.327+0000 7ff61bc1f640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:54.698982+0000 front 2024-09-19T07:25:54.699043+0000 (oldest deadline 2024-09-19T07:26:17.599109+0000) 2024-09-19T07:26:20.624 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:20 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:20.271+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:20.975 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:20 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:20.549+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:21.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:20.933+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:21.623 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:21 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3[51797]: 2024-09-19T07:26:21.318+0000 7ff61bc1f640 -1 osd.3 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:54.698982+0000 front 2024-09-19T07:25:54.699043+0000 (oldest deadline 2024-09-19T07:26:17.599109+0000) 2024-09-19T07:26:21.624 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:21 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:21.306+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:21.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:21.423+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:21.975 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:21 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:21.578+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:22.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:21.939+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:22.623 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:22 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:22.262+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:22.624 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:22 smithi029 podman[95648]: 2024-09-19 07:26:22.348069942 +0000 UTC m=+5.687138781 container died 4a0313daa2d952edcf3a92af94755c0855ac520cdd64a5de8dda9120811ce14e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T07:26:22.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:22.422+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:22.975 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:22 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:22.615+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:23.034 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:22 smithi029 podman[95648]: 2024-09-19 07:26:22.739816891 +0000 UTC m=+6.078885723 container cleanup 4a0313daa2d952edcf3a92af94755c0855ac520cdd64a5de8dda9120811ce14e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T07:26:23.034 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:22 smithi029 bash[95648]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3 2024-09-19T07:26:23.352 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95663]: 2024-09-19 07:26:23.034451337 +0000 UTC m=+0.686606409 container remove 4a0313daa2d952edcf3a92af94755c0855ac520cdd64a5de8dda9120811ce14e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T07:26:23.352 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:23 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:23.242+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:23.375 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:22.971+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:23.623 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95753]: 2024-09-19 07:26:23.255025209 +0000 UTC m=+0.016631740 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:23.624 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95753]: 2024-09-19 07:26:23.387902307 +0000 UTC m=+0.149508839 container create d971fd2eee0599a6a6bfd6bb4fdea33e99dcd909c5cc1ef08d3719e4387a310b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:23.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:23.376+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:23.975 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:23 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:23.633+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:24.124 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95753]: 2024-09-19 07:26:23.650952427 +0000 UTC m=+0.412558966 container init d971fd2eee0599a6a6bfd6bb4fdea33e99dcd909c5cc1ef08d3719e4387a310b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T07:26:24.124 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95753]: 2024-09-19 07:26:23.654529285 +0000 UTC m=+0.416135819 container start d971fd2eee0599a6a6bfd6bb4fdea33e99dcd909c5cc1ef08d3719e4387a310b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:26:24.124 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95753]: 2024-09-19 07:26:23.751372376 +0000 UTC m=+0.512978933 container attach d971fd2eee0599a6a6bfd6bb4fdea33e99dcd909c5cc1ef08d3719e4387a310b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:26:24.124 INFO:journalctl@ceph.osd.3.smithi029.stdout:Sep 19 07:26:23 smithi029 podman[95753]: 2024-09-19 07:26:23.849035168 +0000 UTC m=+0.610641714 container died d971fd2eee0599a6a6bfd6bb4fdea33e99dcd909c5cc1ef08d3719e4387a310b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T07:26:24.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:23.943+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:24.561 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:24 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:24.234+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:24.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T07:26:24.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:24.628 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T07:26:24.628 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T07:26:24.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.4 2024-09-19T07:26:24.696 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:24.400+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:24.972 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:24 smithi046 systemd[1]: Stopping Ceph osd.4 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:24.973 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:24 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:24.614+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:25.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:24.940+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:25.225 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:24 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:24.971+0000 7fc06ba84640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:25.225 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:24 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:24.971+0000 7fc06ba84640 -1 osd.4 96 *** Got signal Terminated *** 2024-09-19T07:26:25.225 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:24 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:24.971+0000 7fc06ba84640 -1 osd.4 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:25.623 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:25 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:25.206+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:25.624 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:25 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:25.206+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:25.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:25.370+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:25.976 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:25 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:25.627+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:26.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:26 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:26.211+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:26.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:26 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:26.211+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:26.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:26 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:26.098+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:26.412 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:25.967+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:26.474 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:26 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:26.019+0000 7fc064092640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:00.519650+0000 front 2024-09-19T07:26:00.519686+0000 (oldest deadline 2024-09-19T07:26:25.819846+0000) 2024-09-19T07:26:26.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:26.412+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:26.974 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:26 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:26.621+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:27.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:27 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:27.099+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:27.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:27 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:27.172+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:27.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:27 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:27.172+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:27.394 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:26.956+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:27.439 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:26 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:26.974+0000 7fc064092640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:00.519650+0000 front 2024-09-19T07:26:00.519686+0000 (oldest deadline 2024-09-19T07:26:25.819846+0000) 2024-09-19T07:26:27.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:27 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:27.394+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:27.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:27 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:27.437+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:27.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:27 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:27.578+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:27.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:27 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:27.578+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:28.224 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:27 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:27.945+0000 7fc064092640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:00.519650+0000 front 2024-09-19T07:26:00.519686+0000 (oldest deadline 2024-09-19T07:26:25.819846+0000) 2024-09-19T07:26:28.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:28 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:28.082+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:28.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:28 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:28.189+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:28.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:28 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:28.189+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:28.381 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:27 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:27.976+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:28.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:28 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:28.380+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:28.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:28 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:28.380+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:28.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:28 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:28.443+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:28.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:28 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:28.579+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:28.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:28 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:28.579+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:29.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:29 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:29.040+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:29.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:29 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:29.183+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:29.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:29 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:29.183+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:29.414 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:28 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:28.970+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:29.414 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:29 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:29.017+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:29.415 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:28 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4[45056]: 2024-09-19T07:26:28.994+0000 7fc064092640 -1 osd.4 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:00.519650+0000 front 2024-09-19T07:26:00.519686+0000 (oldest deadline 2024-09-19T07:26:25.819846+0000) 2024-09-19T07:26:29.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:29 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:29.413+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:29.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:29 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:29.413+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:29.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:29 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:29.415+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:29.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:29 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:29.534+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:29.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:29 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:29.534+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:30.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:30 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:30.041+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:30.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:30 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:30.174+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:30.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:30 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:30.174+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:30.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:30.020+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:30.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:30.016+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:30.686 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:30 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:30.399+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:30.687 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:30 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:30.486+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:30.687 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:30 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:30.486+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:30.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:30.444+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:30.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:30.444+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:30.974 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:30 smithi046 podman[69000]: 2024-09-19 07:26:30.686711073 +0000 UTC m=+5.846596156 container died 3736c108ea4897efc954736ad2aa1282c4005c2fba59688be43e91cee4eeca93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:26:31.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:31 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:31.056+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:31.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:31 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:31.131+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:31.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:31 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:31.131+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:31.431 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:31 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:31.041+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:31.432 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:30 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:30.973+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:31.435 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:31 smithi046 podman[69000]: 2024-09-19 07:26:31.263800598 +0000 UTC m=+6.423685671 container cleanup 3736c108ea4897efc954736ad2aa1282c4005c2fba59688be43e91cee4eeca93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T07:26:31.435 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:31 smithi046 bash[69000]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4 2024-09-19T07:26:31.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:31 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:31.431+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:31.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:31 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:31.431+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:31.724 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:31 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:31.433+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:31.725 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:31 smithi046 podman[69016]: 2024-09-19 07:26:31.565332686 +0000 UTC m=+0.878433946 container remove 3736c108ea4897efc954736ad2aa1282c4005c2fba59688be43e91cee4eeca93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T07:26:31.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:31 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:31.475+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:31.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:31 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:31.475+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:32.225 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:31 smithi046 podman[69103]: 2024-09-19 07:26:31.784222257 +0000 UTC m=+0.017113590 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:32.225 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:31 smithi046 podman[69103]: 2024-09-19 07:26:31.899321651 +0000 UTC m=+0.132212974 container create 2cb7f2b84c9dec6f4442ea9d843635340450dc74f599c77397310844e020b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-19T07:26:32.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:32 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:32.048+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:32.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:32 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:32.141+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:32.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:32 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:32.141+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:32.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:32 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:32.011+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:32.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:32 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:32.004+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:32.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:32 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:32.408+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:32.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:32 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:32.436+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:32.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:32 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:32.436+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:32.725 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:32 smithi046 podman[69103]: 2024-09-19 07:26:32.327083061 +0000 UTC m=+0.559974391 container init 2cb7f2b84c9dec6f4442ea9d843635340450dc74f599c77397310844e020b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T07:26:32.726 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:32 smithi046 podman[69103]: 2024-09-19 07:26:32.330618769 +0000 UTC m=+0.563510097 container start 2cb7f2b84c9dec6f4442ea9d843635340450dc74f599c77397310844e020b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:32.726 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:32 smithi046 podman[69103]: 2024-09-19 07:26:32.410308064 +0000 UTC m=+0.643199394 container attach 2cb7f2b84c9dec6f4442ea9d843635340450dc74f599c77397310844e020b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:32.726 INFO:journalctl@ceph.osd.4.smithi046.stdout:Sep 19 07:26:32 smithi046 podman[69103]: 2024-09-19 07:26:32.530609941 +0000 UTC m=+0.763501265 container died 2cb7f2b84c9dec6f4442ea9d843635340450dc74f599c77397310844e020b78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:26:32.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:32 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:32.475+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:32.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:32 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:32.475+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:33.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T07:26:33.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:33.263 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T07:26:33.263 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T07:26:33.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.5 2024-09-19T07:26:33.291 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:33.028+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:33.291 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:33.046+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:33.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:33.064+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:33.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:33.105+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:33.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:33.105+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:33.448 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:33 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:33.419+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:33.672 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:33 smithi078 systemd[1]: Stopping Ceph osd.5 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:33.673 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:33.506+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:33.673 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:33.506+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:33.673 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:33.672+0000 7fcc81820640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:33.673 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:33.672+0000 7fcc81820640 -1 osd.5 96 *** Got signal Terminated *** 2024-09-19T07:26:33.673 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:33.672+0000 7fcc81820640 -1 osd.5 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:33.724 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:33 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:33.448+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:33.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:33 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:33.448+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:34.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:34.020+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:34.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:34.131+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:34.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:34 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:34.131+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:34.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:33 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:33.996+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:34.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:34 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:34.014+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:34.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:34 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:34.421+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:34.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:34 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:34.402+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:34.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:34 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:34.402+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:34.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:34 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:34.493+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:34.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:34 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:34.493+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:35.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:35 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:35.018+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:35.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:35 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:35.176+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:35.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:35 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:35.176+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:35.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:34 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:34.998+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:35.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:35 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:35.035+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:35.626 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:35 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:35.443+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:35.626 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:35 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:35.356+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:35.626 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:35 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:35.356+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:35.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:35 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:35.474+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:35.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:35 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:35.474+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:36.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:36.038+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:36.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:36.210+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:36.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:36 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:36.210+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:36.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:36 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:36.040+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:36.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:36 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:36.024+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:36.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:36 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:36.024+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:36.643 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:36 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:36.398+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:36.644 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:36 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:36.315+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:36.644 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:36 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:36.315+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:36.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:36 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:36.474+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:36.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:36 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:36.474+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:37.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:37.029+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:37.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:37.029+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:37.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:37.173+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:37.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:37.173+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:37.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:37.173+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:37.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:37.003+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:37.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:37.003+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:37.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:37.012+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:37.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:37.012+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:37.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:37 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:37.279+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:37.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:37 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:37.279+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:37.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:37 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:37.353+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:37.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:37 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:37.353+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:37.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:37.456+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:37.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:37.456+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:38.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:38 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:38.020+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:38.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:38 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:38.020+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:38.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:38 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:38.199+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:38.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:38 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:38.199+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:38.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:38 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:38.199+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:38.420 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:37.962+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:38.420 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:37 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:37.962+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:38.420 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:38 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:38.004+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:38.420 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:38 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:38.004+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:38.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:38 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:38.419+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:52.846393+0000 front 2024-09-19T07:25:52.846378+0000 (oldest deadline 2024-09-19T07:26:21.046895+0000) 2024-09-19T07:26:38.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:38 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:38.419+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.348192+0000 front 2024-09-19T07:26:03.348180+0000 (oldest deadline 2024-09-19T07:26:28.048188+0000) 2024-09-19T07:26:38.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:38 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5[46183]: 2024-09-19T07:26:38.419+0000 7fcc79e2e640 -1 osd.5 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.250075+0000 front 2024-09-19T07:26:13.250120+0000 (oldest deadline 2024-09-19T07:26:37.950231+0000) 2024-09-19T07:26:38.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:38 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:38.374+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:38.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:38 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:38.374+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:38.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:38 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:38.274+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:38.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:38 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:38.274+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:38.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:38 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:38.274+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:39.275 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:39.018+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:39.275 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:39.018+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:39.275 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:39.234+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:39.275 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:39.234+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:39.275 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:39.234+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:39.350 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:39 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:39.003+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:39.351 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:39 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:39.003+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:39.351 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:39 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:39.046+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:39.351 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:39 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:39.046+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:39.674 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:39 smithi078 podman[70221]: 2024-09-19 07:26:39.35073964 +0000 UTC m=+5.879608985 container died 2a163b7d2917358f16eb5346064551bb1e5a89379c250fa27bf88187765eb12c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T07:26:39.724 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:39 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:39.337+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:39.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:39 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:39.337+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:39.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:39 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:39.302+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:39.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:39 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:39.302+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:39.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:39 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:39.302+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:39.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:39 smithi078 podman[70221]: 2024-09-19 07:26:39.77310189 +0000 UTC m=+6.301971234 container cleanup 2a163b7d2917358f16eb5346064551bb1e5a89379c250fa27bf88187765eb12c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:26:39.945 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:39 smithi078 bash[70221]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5 2024-09-19T07:26:40.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:39.994+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:40.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:39 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:39.994+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:40.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:40.215+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:40.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:40.215+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:40.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:40.215+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:40.433 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70237]: 2024-09-19 07:26:40.016045478 +0000 UTC m=+0.664831320 container remove 2a163b7d2917358f16eb5346064551bb1e5a89379c250fa27bf88187765eb12c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T07:26:40.433 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:40 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:40.056+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:40.433 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:40 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:40.056+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:40.434 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:39 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:39.998+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:40.434 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:39 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:39.998+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:40.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70324]: 2024-09-19 07:26:40.33586744 +0000 UTC m=+0.016050314 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:40.695 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70324]: 2024-09-19 07:26:40.458748895 +0000 UTC m=+0.138931758 container create f960d32f1ad45de5c339fda156a462a097b76653826116e3fc7ba3f328104a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T07:26:40.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:40 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:40.351+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:40.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:40 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:40.351+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:40.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:40 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:40.266+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:40.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:40 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:40.266+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:40.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:40 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:40.266+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:41.033 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70324]: 2024-09-19 07:26:40.744632029 +0000 UTC m=+0.424814900 container init f960d32f1ad45de5c339fda156a462a097b76653826116e3fc7ba3f328104a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T07:26:41.033 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70324]: 2024-09-19 07:26:40.747990442 +0000 UTC m=+0.428173318 container start f960d32f1ad45de5c339fda156a462a097b76653826116e3fc7ba3f328104a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T07:26:41.033 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70324]: 2024-09-19 07:26:40.836150929 +0000 UTC m=+0.516333819 container attach f960d32f1ad45de5c339fda156a462a097b76653826116e3fc7ba3f328104a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T07:26:41.034 INFO:journalctl@ceph.osd.5.smithi078.stdout:Sep 19 07:26:40 smithi078 podman[70347]: 2024-09-19 07:26:40.958480783 +0000 UTC m=+0.016827033 container died f960d32f1ad45de5c339fda156a462a097b76653826116e3fc7ba3f328104a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:41.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:40.974+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:41.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:40 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:40.974+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:41.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:41.167+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:41.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:41.167+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:41.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:41.167+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:41.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:41 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:41.032+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:41.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:41 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:41.032+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:41.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:41 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:41.096+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:41.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:41 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:41.096+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:41.627 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T07:26:41.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:41.710 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T07:26:41.710 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T07:26:41.710 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.6 2024-09-19T07:26:41.724 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:41 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:41.342+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:41.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:41 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:41.342+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:41.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:41 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:41.274+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:41.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:41 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:41.274+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:41.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:41 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:41.274+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:42.034 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:41 smithi029 systemd[1]: Stopping Ceph osd.6 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:42.035 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:41.929+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:42.035 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:41.930+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:42.035 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:42.033+0000 7f3bc58b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:42.035 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:42.033+0000 7f3bc58b0640 -1 osd.6 96 *** Got signal Terminated *** 2024-09-19T07:26:42.035 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:42.033+0000 7f3bc58b0640 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:42.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:42.168+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:42.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:42.168+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:42.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:42.168+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:42.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:42 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:42.001+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:42.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:42 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:42.001+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:42.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:42 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:42.140+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:42.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:42 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:42.140+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:42.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:42.323+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:42.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:42.323+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:42.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:42.296+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:42.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:42.297+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:42.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:42 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:42.297+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:43.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:42.959+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:43.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:42.959+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:43.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:42 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:42.959+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.318520+0000 front 2024-09-19T07:26:20.318438+0000 (oldest deadline 2024-09-19T07:26:42.618579+0000) 2024-09-19T07:26:43.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:43.159+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:43.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:43.159+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:43.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:43.159+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:43.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:43 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:43.159+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:43.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:43 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:43.035+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:43.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:43 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:43.035+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:43.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:43 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:43.097+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:43.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:43 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:43.097+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:43.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:43 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:43.346+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:43.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:43 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:43.346+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:43.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:43 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:43.261+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:43.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:43 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:43.261+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:43.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:43 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:43.261+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:44.004+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:44.004+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:44.004+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.318520+0000 front 2024-09-19T07:26:20.318438+0000 (oldest deadline 2024-09-19T07:26:42.618579+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:44.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:44.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:44.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:44.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:44 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:44.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:44.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:44.111+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:44.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:44.111+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:44.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:44.004+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:44.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:44.004+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:44.446 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:44.004+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:44.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:44 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:44.331+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:44.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:44 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:44.331+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:44.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:44 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:44.271+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:44.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:44 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:44.271+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:44.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:44 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:44.271+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:45.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:45.031+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:45.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:45.031+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:45.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:45.031+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.318520+0000 front 2024-09-19T07:26:20.318438+0000 (oldest deadline 2024-09-19T07:26:42.618579+0000) 2024-09-19T07:26:45.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:45.138+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:45.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:45.138+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:45.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:45.138+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:45.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:45 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:45.138+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:45.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:45 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:45.098+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:45.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:45 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:45.098+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:45.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:44.978+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:45.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:44.978+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:45.446 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:44 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:44.978+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:45.724 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:45.286+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:45.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:45.286+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:45.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:45.286+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:45.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:45.286+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:45.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:45.286+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:45.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:45.286+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:46.373 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:46.017+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.714732+0000 front 2024-09-19T07:26:01.714764+0000 (oldest deadline 2024-09-19T07:26:25.715633+0000) 2024-09-19T07:26:46.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:46.017+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.717636+0000 front 2024-09-19T07:26:12.717404+0000 (oldest deadline 2024-09-19T07:26:36.217465+0000) 2024-09-19T07:26:46.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6[58688]: 2024-09-19T07:26:46.017+0000 7f3bc1ec6640 -1 osd.6 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.318520+0000 front 2024-09-19T07:26:20.318438+0000 (oldest deadline 2024-09-19T07:26:42.618579+0000) 2024-09-19T07:26:46.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:46.147+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:46.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:46.147+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:46.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:46.147+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:46.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:46 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:46.147+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:46.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:45 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:45.955+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:46.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:45 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:45.955+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:46.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:45 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:45.955+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:46.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:46 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:46.050+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:46.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:46 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:46.050+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:46.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:46 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:46.050+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:46.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:46 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:46.240+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:46.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:46 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:46.240+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:46.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:46 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:46.240+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:46.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:46 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:46.304+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:46.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:46 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:46.304+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:46.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:46 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:46.304+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:47.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:47 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:47.070+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:47.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:47 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:47.070+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:47.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:47 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:47.070+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:47.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:46 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:46.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:47.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:46 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:46.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:47.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:46 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:46.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:47.577 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:47.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:47.577 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:47.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:47.577 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:47.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:47.577 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:47 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:47.143+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:47.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:47.284+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:47.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:47.284+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:47.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:47.284+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:47.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:47.342+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:47.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:47.342+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:47.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:47.342+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:47.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:47 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:47.342+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:47.873 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:47 smithi029 podman[95858]: 2024-09-19 07:26:47.577768132 +0000 UTC m=+5.669191713 container died 737b641ff8d906afede0149cc23cf010d64213908faa88c463e29e6970d3efd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:48.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:47 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:47.912+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:48.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:47 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:47.912+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:48.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:47 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:47.912+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:48.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:48 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:48.055+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:48.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:48 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:48.055+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:48.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:48 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:48.055+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:48.341 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 podman[95858]: 2024-09-19 07:26:48.070642713 +0000 UTC m=+6.162066292 container cleanup 737b641ff8d906afede0149cc23cf010d64213908faa88c463e29e6970d3efd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:48.341 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 bash[95858]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6 2024-09-19T07:26:48.342 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:48 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:48.114+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:48.342 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:48 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:48.114+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:48.342 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:48 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:48.114+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:48.342 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:48 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:48.114+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:48.623 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 podman[95874]: 2024-09-19 07:26:48.341521694 +0000 UTC m=+0.761116808 container remove 737b641ff8d906afede0149cc23cf010d64213908faa88c463e29e6970d3efd6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T07:26:48.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:48.289+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:48.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:48.289+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:48.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:48.289+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:48.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:48.335+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:48.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:48.335+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:48.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:48.335+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:48.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:48.335+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:48.930 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 podman[95963]: 2024-09-19 07:26:48.56216195 +0000 UTC m=+0.016251976 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:48.930 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 podman[95963]: 2024-09-19 07:26:48.684750118 +0000 UTC m=+0.138840124 container create c2a8e0d15f725896234b26a321b8ad42abb4e4e63d822f751207f19fc31d8447 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T07:26:49.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:48 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:48.894+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:49.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:48 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:48.894+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:49.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:48 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:48.894+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:49.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:49 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:49.098+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:49.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:49 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:49.098+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:49.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:49 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:49.098+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:49.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:49 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:49.064+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:49 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:49.064+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:49 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:49.064+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:49 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:49.064+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 podman[95963]: 2024-09-19 07:26:48.930481131 +0000 UTC m=+0.384571151 container init c2a8e0d15f725896234b26a321b8ad42abb4e4e63d822f751207f19fc31d8447 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:48 smithi029 podman[95963]: 2024-09-19 07:26:48.934235145 +0000 UTC m=+0.388325152 container start c2a8e0d15f725896234b26a321b8ad42abb4e4e63d822f751207f19fc31d8447 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:49 smithi029 podman[95963]: 2024-09-19 07:26:49.049367595 +0000 UTC m=+0.503457615 container attach c2a8e0d15f725896234b26a321b8ad42abb4e4e63d822f751207f19fc31d8447 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T07:26:49.374 INFO:journalctl@ceph.osd.6.smithi029.stdout:Sep 19 07:26:49 smithi029 podman[95963]: 2024-09-19 07:26:49.133507708 +0000 UTC m=+0.587597732 container died c2a8e0d15f725896234b26a321b8ad42abb4e4e63d822f751207f19fc31d8447 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:26:49.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:49.252+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:49.780 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:49.252+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:49.780 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:49.252+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:49.780 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:49.336+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:49.780 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:49.336+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:49.780 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:49.336+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:49.780 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:49 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:49.336+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:49.831 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T07:26:49.879 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:49.879 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T07:26:49.879 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T07:26:49.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.7 2024-09-19T07:26:50.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:50.052+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:50.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:50.052+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:50.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:50.052+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:50.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:50 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:50.052+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:50.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:49 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:49.883+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:50.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:49 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:49.883+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:50.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:49 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:49.883+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:50.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:50.093+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:50.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:50.093+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:50.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:50.093+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:50.208 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:49 smithi046 systemd[1]: Stopping Ceph osd.7 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:50.311+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:50.311+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:50.311+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:50.311+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:50.208+0000 7f2bfe90c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:50.208+0000 7f2bfe90c640 -1 osd.7 96 *** Got signal Terminated *** 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:50.208+0000 7f2bfe90c640 -1 osd.7 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:50.293+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:50.475 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:50.293+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:50.476 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:50 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:50.293+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:51.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:50.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:51.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:50.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:51.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:50 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:50.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:51.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:51.058+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:51.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:51.058+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:51.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:51.058+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:51.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:51 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:51.020+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:51.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:51 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:51.020+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:51.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:51 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:51.020+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:51.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:51 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:51.020+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:51.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:51.284+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:51.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:51.284+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:51.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:51.284+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:51.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:51.284+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:51.726 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:51.280+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:51.726 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:51.280+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:51.726 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:51 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:51.280+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:52.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:51.918+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:52.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:51.918+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:52.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:51.918+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:52.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:51 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:51.918+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:52.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:52.069+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:52.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:52.069+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:52.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:52.069+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:52.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:52.069+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:52.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:52 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:52.029+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:52.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:52 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:52.029+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:52.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:52 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:52.029+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:52.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:52 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:52.029+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:52.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:52.305+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:52.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:52.305+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:52.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:52.305+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:52.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:52.305+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:29.760843+0000 front 2024-09-19T07:26:29.760864+0000 (oldest deadline 2024-09-19T07:26:51.460976+0000) 2024-09-19T07:26:52.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:52.285+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:52.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:52.285+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:52.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:52.285+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:52.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:52.285+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:52.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:52.285+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:53.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:52.870+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:53.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:52.870+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:53.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:52.870+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:53.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:52 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:52.870+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:53.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:53.043+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:53.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:53.043+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:53.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:53.043+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:53.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:53.043+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:53.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:53.027+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:53.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:53.027+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:53.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:53.027+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:53.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:53 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:53.027+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:53.270+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:53.270+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:53.270+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:53.270+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:29.760843+0000 front 2024-09-19T07:26:29.760864+0000 (oldest deadline 2024-09-19T07:26:51.460976+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:53.308+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:53.308+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:53.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:53.308+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:53.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:53.308+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:53.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:53 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:53.308+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:54.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:53.866+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:54.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:53.866+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:54.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:53.866+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:54.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:53 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:53.866+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:54.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:54.060+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:54.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:54.060+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:54.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:54.060+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:54.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:54.060+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:54.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.031+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:54.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.031+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:54.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.031+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:54.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.031+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:54.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:54.232+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:03.356857+0000 front 2024-09-19T07:26:03.356822+0000 (oldest deadline 2024-09-19T07:26:26.857002+0000) 2024-09-19T07:26:54.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:54.232+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:12.158087+0000 front 2024-09-19T07:26:12.158142+0000 (oldest deadline 2024-09-19T07:26:36.858297+0000) 2024-09-19T07:26:54.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:54.232+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.359605+0000 front 2024-09-19T07:26:20.359579+0000 (oldest deadline 2024-09-19T07:26:44.459779+0000) 2024-09-19T07:26:54.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7[51526]: 2024-09-19T07:26:54.232+0000 7f2bf6f1a640 -1 osd.7 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:29.760843+0000 front 2024-09-19T07:26:29.760864+0000 (oldest deadline 2024-09-19T07:26:51.460976+0000) 2024-09-19T07:26:54.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:54.281+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:54.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:54.281+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:54.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:54.281+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:54.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:54.281+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:54.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:54 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:54.281+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:55.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:55.105+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:55.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:55.105+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:55.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:55.105+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:55.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:55.105+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:55.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:54.864+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:55.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:54.864+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:55.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:54.864+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:55.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:54 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:54.864+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:55.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.995+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:55.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.995+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:55.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.995+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:55.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.995+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:55.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:54 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:54.995+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:26:55.724 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:55 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:55.325+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:55.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:55 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:55.325+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:55.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:55 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:55.325+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:55.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:55 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:55.325+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:55.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:55 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:55.325+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:56.050 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:55 smithi046 podman[69217]: 2024-09-19 07:26:55.759869974 +0000 UTC m=+5.676881736 container died acf459efaf97188477379769ac897f89143bca3e69575a3669fc735f8dc424c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:26:56.132 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:55.872+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:56.132 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:55.872+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:56.132 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:55.872+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:56.132 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:55 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:55.872+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:56.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:55 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:55.965+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:56.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:55 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:55.965+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:56.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:55 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:55.965+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:56.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:55 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:55.965+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:56.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:55 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:55.965+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:26:56.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:56.131+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:56.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:56.131+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:56.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:56.131+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:56.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:56.131+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:56 smithi046 podman[69217]: 2024-09-19 07:26:56.173683747 +0000 UTC m=+6.090695530 container cleanup acf459efaf97188477379769ac897f89143bca3e69575a3669fc735f8dc424c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:56 smithi046 bash[69217]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:56.282+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:56.282+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:56.282+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:56.282+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:56.451 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:56.282+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:56.725 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:56 smithi046 podman[69233]: 2024-09-19 07:26:56.451103411 +0000 UTC m=+0.678638993 container remove acf459efaf97188477379769ac897f89143bca3e69575a3669fc735f8dc424c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T07:26:57.046 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:56 smithi046 podman[69318]: 2024-09-19 07:26:56.669492873 +0000 UTC m=+0.016388599 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:26:57.046 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:56 smithi046 podman[69318]: 2024-09-19 07:26:56.793829745 +0000 UTC m=+0.140725460 container create eb61c654b2f4f0b252ae4b4d3df155e777f833ecc948884a6690ee5d25f54841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T07:26:57.195 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:56.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:56.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:56.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:56 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:56.919+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:57.142+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:57.142+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:57.142+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:57.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:57.142+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:57.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:56 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:56.956+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:57.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:56 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:56.956+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:57.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:56 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:56.956+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:57.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:56 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:56.956+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:57.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:56 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:56.956+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:26:57.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:57 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:57.265+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:57.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:57 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:57.265+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:57.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:57 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:57.265+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:57.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:57 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:57.265+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:57.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:57 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:57.265+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:57.476 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:57 smithi046 podman[69318]: 2024-09-19 07:26:57.046383171 +0000 UTC m=+0.393278890 container init eb61c654b2f4f0b252ae4b4d3df155e777f833ecc948884a6690ee5d25f54841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:26:57.476 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:57 smithi046 podman[69318]: 2024-09-19 07:26:57.050074439 +0000 UTC m=+0.396970151 container start eb61c654b2f4f0b252ae4b4d3df155e777f833ecc948884a6690ee5d25f54841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T07:26:57.476 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:57 smithi046 podman[69318]: 2024-09-19 07:26:57.146404573 +0000 UTC m=+0.493300317 container attach eb61c654b2f4f0b252ae4b4d3df155e777f833ecc948884a6690ee5d25f54841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T07:26:57.476 INFO:journalctl@ceph.osd.7.smithi046.stdout:Sep 19 07:26:57 smithi046 podman[69318]: 2024-09-19 07:26:57.242087072 +0000 UTC m=+0.588982806 container died eb61c654b2f4f0b252ae4b4d3df155e777f833ecc948884a6690ee5d25f54841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T07:26:57.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T07:26:57.973 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:26:57.974 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T07:26:57.974 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T07:26:57.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.8 2024-09-19T07:26:58.302 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:58.157+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:58.302 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:58.157+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:58.302 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:58.157+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:58.302 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:58.157+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:58.303 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:57.968+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:58.303 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:57.968+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:58.303 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:57.968+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:58.303 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:57 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:57.968+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:58.303 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 systemd[1]: Stopping Ceph osd.8 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:26:58.304 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.301+0000 7fc155b59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:26:58.304 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.301+0000 7fc155b59640 -1 osd.8 96 *** Got signal Terminated *** 2024-09-19T07:26:58.304 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.301+0000 7fc155b59640 -1 osd.8 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:26:58.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:57 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:57.949+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:58.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:57 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:57.949+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:58.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:57 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:57.949+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:58.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:57 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:57.949+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:58.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:57 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:57.949+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:26:58.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:58 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:58.245+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:58.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:58 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:58.245+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:58.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:58 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:58.245+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:58.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:58 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:58.245+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:58.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:58 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:58.245+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:26:59.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:58 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:58.969+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:26:59.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:58 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:58.969+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:26:59.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:58 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:58.969+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:26:59.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:58 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:58.969+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:26:59.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:58 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:58.969+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:26:59.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.997+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:26:59.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.997+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:26:59.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.997+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:26:59.446 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:58.997+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:26:59.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:59.123+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:26:59.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:59.123+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:26:59.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:59.123+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:26:59.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:26:59.123+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:26:59.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:59.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:26:59.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:59.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:26:59.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:59.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:26:59.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:59.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:26:59.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:26:59 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:26:59.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:00.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:59 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:59.972+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:00.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:59 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:59.972+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:00.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:59 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:59.972+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:00.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:59 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:59.972+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:00.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:59 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:59.972+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:00.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:26:59 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:26:59.972+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:00.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:59.949+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:27:00.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:59.949+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:27:00.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:59.949+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:27:00.446 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:26:59 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:26:59.949+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:27:00.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:00.117+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:00.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:00.117+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:00.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:00.117+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:00.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:00.117+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:00.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:00 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:00.240+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:00.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:00 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:00.240+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:00.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:00 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:00.240+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:00.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:00 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:00.240+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:00.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:00 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:00.240+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:01.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:00.924+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:01.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:00.924+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:01.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:00.924+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:01.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:00.924+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:01.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:00.924+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:01.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:00 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:00.924+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:01.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:00.950+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:27:01.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:00.950+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:27:01.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:00.950+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:27:01.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:00 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:00.950+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:27:01.445 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:01.072+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:01.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:01.072+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:01.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:01.072+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:01.446 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:01.072+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:01.474 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:01 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:01.216+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:01.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:01 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:01.216+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:01.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:01 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:01.216+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:01.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:01 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:01.216+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:01.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:01 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:01.216+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:01.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:01 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:01.216+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:02.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:02.096+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:02.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:02.096+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:02.096+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:02.096+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:01.908+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:01.908+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:01.908+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:01.908+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:27:02.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:01.908+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.224036+0000 front 2024-09-19T07:26:38.224076+0000 (oldest deadline 2024-09-19T07:27:01.724169+0000) 2024-09-19T07:27:02.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:01 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:01.879+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:02.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:01 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:01.879+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:02.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:01 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:01.879+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:02.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:01 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:01.879+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:02.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:01 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:01.879+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:02.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:01 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:01.879+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:02.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:02.198+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:02.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:02.198+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:02.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:02.198+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:02.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:02.198+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:02.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:02.198+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:02.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:02 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:02.198+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:03.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:03 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:03.046+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:03.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:03 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:03.046+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:03.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:03 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:03.046+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:03.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:03 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:03.046+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:03.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:02.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:25:59.818164+0000 front 2024-09-19T07:25:59.818240+0000 (oldest deadline 2024-09-19T07:26:28.618572+0000) 2024-09-19T07:27:03.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:02.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:13.120897+0000 front 2024-09-19T07:26:13.120766+0000 (oldest deadline 2024-09-19T07:26:36.620852+0000) 2024-09-19T07:27:03.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:02.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:16.621176+0000 front 2024-09-19T07:26:16.621271+0000 (oldest deadline 2024-09-19T07:26:43.621591+0000) 2024-09-19T07:27:03.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:02.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:26.522644+0000 front 2024-09-19T07:26:26.522527+0000 (oldest deadline 2024-09-19T07:26:51.222546+0000) 2024-09-19T07:27:03.196 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:02 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8[53099]: 2024-09-19T07:27:02.926+0000 7fc14e167640 -1 osd.8 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.224036+0000 front 2024-09-19T07:26:38.224076+0000 (oldest deadline 2024-09-19T07:27:01.724169+0000) 2024-09-19T07:27:03.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:02 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:02.913+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:03.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:02 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:02.913+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:03.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:02 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:02.913+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:03.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:02 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:02.913+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:03.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:02 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:02.913+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:03.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:02 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:02.913+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:03.474 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:03 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:03.190+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:03.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:03 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:03.190+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:03.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:03 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:03.190+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:03.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:03 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:03.190+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:03.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:03 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:03.190+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:03.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:03 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:03.190+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:04.085 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:03 smithi078 podman[70439]: 2024-09-19 07:27:03.789201197 +0000 UTC m=+5.631054405 container died dbd5030dfad497b98605ab51b669766a5bfc1b3d3c8bbae68ee906620176e9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:27:04.086 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.036+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:04.086 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.036+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:04.086 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.036+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:04.086 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.036+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:04.086 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.036+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:04.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:03 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:03.901+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:04.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:03 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:03.901+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:04.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:03 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:03.901+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:04.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:03 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:03.901+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:04.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:03 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:03.901+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:04.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:03 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:03.901+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:04.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:04 smithi078 podman[70439]: 2024-09-19 07:27:04.201618724 +0000 UTC m=+6.043471918 container cleanup dbd5030dfad497b98605ab51b669766a5bfc1b3d3c8bbae68ee906620176e9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:27:04.445 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:04 smithi078 bash[70439]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8 2024-09-19T07:27:04.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:04.181+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:04.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:04.181+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:04.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:04.181+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:04.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:04.181+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:04.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:04.181+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:04.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:04 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:04.181+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:04.945 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:04 smithi078 podman[70455]: 2024-09-19 07:27:04.47806007 +0000 UTC m=+0.690372300 container remove dbd5030dfad497b98605ab51b669766a5bfc1b3d3c8bbae68ee906620176e9fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:27:05.239 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.987+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:05.239 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.987+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:05.239 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.987+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:05.239 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.987+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:05.239 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:04 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:04.987+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:05.240 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:04 smithi078 podman[70542]: 2024-09-19 07:27:04.864020311 +0000 UTC m=+0.016022140 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:27:05.240 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:04 smithi078 podman[70542]: 2024-09-19 07:27:04.98713938 +0000 UTC m=+0.139141205 container create d32ba90ad808ff31f4932073b88ac872c9922594dc1a207bb05cecbeea6cf546 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:27:05.240 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:05 smithi078 podman[70542]: 2024-09-19 07:27:05.239595223 +0000 UTC m=+0.391597041 container init d32ba90ad808ff31f4932073b88ac872c9922594dc1a207bb05cecbeea6cf546 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T07:27:05.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:04.925+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:05.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:04.925+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:05.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:04.925+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:05.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:04.925+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:05.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:04.925+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:05.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:04 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:04.925+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:05.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:05 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:05.153+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:05.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:05 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:05.153+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:05.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:05 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:05.153+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:05.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:05 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:05.153+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:05.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:05 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:05.153+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:05.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:05 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:05.153+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:05.695 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:05 smithi078 podman[70542]: 2024-09-19 07:27:05.243610873 +0000 UTC m=+0.395612697 container start d32ba90ad808ff31f4932073b88ac872c9922594dc1a207bb05cecbeea6cf546 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:27:05.695 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:05 smithi078 podman[70542]: 2024-09-19 07:27:05.306203303 +0000 UTC m=+0.458205123 container attach d32ba90ad808ff31f4932073b88ac872c9922594dc1a207bb05cecbeea6cf546 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:27:05.695 INFO:journalctl@ceph.osd.8.smithi078.stdout:Sep 19 07:27:05 smithi078 podman[70542]: 2024-09-19 07:27:05.433380934 +0000 UTC m=+0.585382755 container died d32ba90ad808ff31f4932073b88ac872c9922594dc1a207bb05cecbeea6cf546 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-19T07:27:06.026 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:05 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:05.941+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:06.026 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:05 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:05.941+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:06.026 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:05 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:05.941+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:06.026 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:05 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:05.941+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:06.026 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:05 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:05.941+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:06.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T07:27:06.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:06.088 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T07:27:06.088 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T07:27:06.088 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.9 2024-09-19T07:27:06.143 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:05 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:05.877+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:06.144 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:05 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:05.877+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:06.144 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:05 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:05.877+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:06.144 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:05 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:05.877+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:06.144 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:05 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:05.877+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:06.144 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:05 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:05.877+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:06.396 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 systemd[1]: Stopping Ceph osd.9 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:06.474 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:06.178+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:06.178+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:06.178+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:06.178+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:06.178+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:06.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:06 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:06.178+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:06.873 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.394+0000 7f4dedd19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:06.873 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.394+0000 7f4dedd19640 -1 osd.9 96 *** Got signal Terminated *** 2024-09-19T07:27:06.873 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.394+0000 7f4dedd19640 -1 osd.9 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:27:07.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:06.915+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:07.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:06.915+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:07.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:06.915+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:07.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:06.915+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:07.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:06.915+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:07.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.906+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:07.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.906+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:07.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.906+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:07.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.906+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:07.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.906+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:07.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:06 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:06.906+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:07.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:07 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:07.191+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:07.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:07 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:07.191+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:07.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:07 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:07.191+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:07.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:07 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:07.191+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:07.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:07 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:07.191+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:07.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:07 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:07.191+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:08.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:07 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:07.914+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:08.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:07 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:07.914+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:08.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:07 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:07.914+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:08.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:07 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:07.914+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:08.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:07 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:07.914+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:08.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:07 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:07.936+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:08.373 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:07 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:07.936+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:08.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:07 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:07.936+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:08.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:07 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:07.936+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:08.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:07 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:07.936+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:08.374 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:07 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:07.936+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:08.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:08.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:08.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:08.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:08.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:08.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:08.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:08.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:08.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:08.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:08.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:08 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:08.233+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:09.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:08.867+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:09.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:08.867+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:09.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:08.867+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:09.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:08.867+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:09.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:08 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:08.867+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:09.276 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:08.894+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:09.276 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:08.894+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:09.276 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:08.894+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:09.276 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:08.894+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:09.276 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:08.894+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:09.276 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:08 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:08.894+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:09.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:09 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:09.186+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:10.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:09.846+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:10.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:09.846+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:10.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:09.846+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:10.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:09.846+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:10.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:09.846+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:10.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:09 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:09.846+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:10.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:09 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:09.860+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:10.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:09 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:09.860+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:10.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:09 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:09.860+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:10.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:09 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:09.860+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:10.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:09 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:09.860+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:10.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:09 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:09.860+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:10.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:10.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:10.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:10.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:10.476 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:10.476 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:10.476 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:10 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:10.155+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:11.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:10.837+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.786669+0000 front 2024-09-19T07:25:51.786625+0000 (oldest deadline 2024-09-19T07:26:17.686778+0000) 2024-09-19T07:27:11.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:10.837+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:01.088960+0000 front 2024-09-19T07:26:01.088597+0000 (oldest deadline 2024-09-19T07:26:25.188722+0000) 2024-09-19T07:27:11.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:10.837+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.089637+0000 front 2024-09-19T07:26:11.089759+0000 (oldest deadline 2024-09-19T07:26:36.989837+0000) 2024-09-19T07:27:11.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:10.837+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:18.090603+0000 front 2024-09-19T07:26:18.090649+0000 (oldest deadline 2024-09-19T07:26:42.790665+0000) 2024-09-19T07:27:11.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:10.837+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:28.592710+0000 front 2024-09-19T07:26:28.592695+0000 (oldest deadline 2024-09-19T07:26:54.993634+0000) 2024-09-19T07:27:11.124 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:10 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9[65508]: 2024-09-19T07:27:10.837+0000 7f4dea32f640 -1 osd.9 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:34.994453+0000 front 2024-09-19T07:26:34.994499+0000 (oldest deadline 2024-09-19T07:26:59.694278+0000) 2024-09-19T07:27:11.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:10.859+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:11.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:10.859+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:11.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:10.859+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:11.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:10.859+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:11.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:10.859+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:11.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:10 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:10.859+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:11.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:11 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:11.192+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:12.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:11 smithi029 podman[96066]: 2024-09-19 07:27:11.870948764 +0000 UTC m=+5.574960907 container died e39dcf60de185739e0b6ea7e67061dfaa96183e93564ee4aa3a33ff82de49c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:27:12.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:11.839+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:12.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:11.839+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:12.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:11.839+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:12.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:11.839+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:12.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:11.839+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:12.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:11.839+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:12.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:12 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:12.205+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:12.535 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:12 smithi029 podman[96066]: 2024-09-19 07:27:12.26684637 +0000 UTC m=+5.970858556 container cleanup e39dcf60de185739e0b6ea7e67061dfaa96183e93564ee4aa3a33ff82de49c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T07:27:12.535 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:12 smithi029 bash[96066]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9 2024-09-19T07:27:12.853 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:12 smithi029 podman[96093]: 2024-09-19 07:27:12.535624489 +0000 UTC m=+0.656748217 container remove e39dcf60de185739e0b6ea7e67061dfaa96183e93564ee4aa3a33ff82de49c09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T07:27:13.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:12 smithi029 podman[96181]: 2024-09-19 07:27:12.756813357 +0000 UTC m=+0.016190951 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:27:13.123 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:12 smithi029 podman[96181]: 2024-09-19 07:27:12.853829072 +0000 UTC m=+0.113206659 container create cd101d0c45b5efe944aeb7f78942779b137cf9bbcc99b2ac3a4c3e79464619aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T07:27:13.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:12.888+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:13.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:12.888+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:13.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:12.888+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:13.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:12.888+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:13.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:12.888+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:13.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:12 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:12.888+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:13.623 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:13 smithi029 podman[96181]: 2024-09-19 07:27:13.124657726 +0000 UTC m=+0.384035323 container init cd101d0c45b5efe944aeb7f78942779b137cf9bbcc99b2ac3a4c3e79464619aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T07:27:13.623 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:13 smithi029 podman[96181]: 2024-09-19 07:27:13.128241843 +0000 UTC m=+0.387619432 container start cd101d0c45b5efe944aeb7f78942779b137cf9bbcc99b2ac3a4c3e79464619aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T07:27:13.623 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:13 smithi029 podman[96181]: 2024-09-19 07:27:13.218407201 +0000 UTC m=+0.477784795 container attach cd101d0c45b5efe944aeb7f78942779b137cf9bbcc99b2ac3a4c3e79464619aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T07:27:13.623 INFO:journalctl@ceph.osd.9.smithi029.stdout:Sep 19 07:27:13 smithi029 podman[96181]: 2024-09-19 07:27:13.324635455 +0000 UTC m=+0.584013054 container died cd101d0c45b5efe944aeb7f78942779b137cf9bbcc99b2ac3a4c3e79464619aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:13.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:13 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:13.248+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:13.945 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T07:27:13.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:13.991 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T07:27:13.991 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T07:27:13.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.10 2024-09-19T07:27:14.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:13.862+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:14.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:13.862+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:14.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:13.862+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:14.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:13.862+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:14.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:13.862+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:14.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:13 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:13.862+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:14.311 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 systemd[1]: Stopping Ceph osd.10 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.267+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.311+0000 7f9336def640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:14.312 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.311+0000 7f9336def640 -1 osd.10 96 *** Got signal Terminated *** 2024-09-19T07:27:14.313 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:14 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:14.311+0000 7f9336def640 -1 osd.10 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:27:15.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:14.816+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:15.197 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:14.816+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:15.197 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:14.816+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:15.197 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:14.816+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:15.197 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:14.816+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:15.197 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:14 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:14.816+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:15.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:15 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:15.249+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:16.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:15.828+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:16.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:15.828+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:16.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:15.828+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:16.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:15.828+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:16.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:15.828+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:16.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:15 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:15.828+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:16.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:16 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:16.214+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:17.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:16 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:16.797+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:17.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:16 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:16.797+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:17.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:16 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:16.797+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:17.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:16 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:16.797+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:17.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:16 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:16.797+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:17.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:16 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:16.797+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:17.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:17 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:17.219+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:18.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:17 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:17.796+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:18.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:17 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:17.796+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:18.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:17 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:17.796+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:18.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:17 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:17.796+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:18.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:17 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:17.796+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:18.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:17 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:17.796+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:18.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:18.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:18.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:18.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:18.725 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:18.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:18.726 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:18 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:18.263+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:19.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:18 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:18.755+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:19.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:18 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:18.755+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:19.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:18 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:18.755+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:19.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:18 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:18.755+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:19.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:18 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:18.755+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:19.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:18 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:18.755+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:51.404956+0000 front 2024-09-19T07:25:51.404969+0000 (oldest deadline 2024-09-19T07:26:17.205410+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6804 osd.1 since back 2024-09-19T07:26:02.307591+0000 front 2024-09-19T07:26:02.307627+0000 (oldest deadline 2024-09-19T07:26:27.007843+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.609580+0000 front 2024-09-19T07:26:11.609366+0000 (oldest deadline 2024-09-19T07:26:37.509454+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.410555+0000 front 2024-09-19T07:26:20.410789+0000 (oldest deadline 2024-09-19T07:26:46.310538+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:27.411576+0000 front 2024-09-19T07:26:27.411616+0000 (oldest deadline 2024-09-19T07:26:51.511716+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:36.812755+0000 front 2024-09-19T07:26:36.812686+0000 (oldest deadline 2024-09-19T07:27:00.312616+0000) 2024-09-19T07:27:19.475 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10[58500]: 2024-09-19T07:27:19.217+0000 7f9333405640 -1 osd.10 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.213829+0000 front 2024-09-19T07:26:43.213908+0000 (oldest deadline 2024-09-19T07:27:08.513660+0000) 2024-09-19T07:27:20.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:19 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:19.771+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:20.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:19 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:19.771+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:20.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:19 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:19.771+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:20.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:19 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:19.771+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:20.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:19 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:19.771+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:20.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:19 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:19.771+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:20.211 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:19 smithi046 podman[69432]: 2024-09-19 07:27:19.945208084 +0000 UTC m=+5.753892953 container died 3dce432965ee4c3be9c4427447122fc0401b55800334faafbbe72a238ead8517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T07:27:20.474 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:20 smithi046 podman[69432]: 2024-09-19 07:27:20.310837537 +0000 UTC m=+6.119522405 container cleanup 3dce432965ee4c3be9c4427447122fc0401b55800334faafbbe72a238ead8517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:27:20.514 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:20 smithi046 bash[69432]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10 2024-09-19T07:27:20.912 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:20 smithi046 podman[69451]: 2024-09-19 07:27:20.595096662 +0000 UTC m=+0.642613375 container remove 3dce432965ee4c3be9c4427447122fc0401b55800334faafbbe72a238ead8517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:27:21.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:21.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:21.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:21.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:21.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:21.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:21.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:20 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:20.801+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:21.224 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:20 smithi046 podman[69537]: 2024-09-19 07:27:20.912532708 +0000 UTC m=+0.112085214 container create efd25e6befa02da3a909fb146d9c850b7283e2f332e45732cb8d6ee4e0afb881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T07:27:21.225 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:20 smithi046 podman[69537]: 2024-09-19 07:27:20.817120233 +0000 UTC m=+0.016672758 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:27:21.225 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:21 smithi046 podman[69537]: 2024-09-19 07:27:21.147935382 +0000 UTC m=+0.347487888 container init efd25e6befa02da3a909fb146d9c850b7283e2f332e45732cb8d6ee4e0afb881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-19T07:27:21.225 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:21 smithi046 podman[69537]: 2024-09-19 07:27:21.151371679 +0000 UTC m=+0.350924185 container start efd25e6befa02da3a909fb146d9c850b7283e2f332e45732cb8d6ee4e0afb881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T07:27:21.642 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:21 smithi046 podman[69537]: 2024-09-19 07:27:21.231249371 +0000 UTC m=+0.430801914 container attach efd25e6befa02da3a909fb146d9c850b7283e2f332e45732cb8d6ee4e0afb881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T07:27:21.642 INFO:journalctl@ceph.osd.10.smithi046.stdout:Sep 19 07:27:21 smithi046 podman[69537]: 2024-09-19 07:27:21.350575745 +0000 UTC m=+0.550128264 container died efd25e6befa02da3a909fb146d9c850b7283e2f332e45732cb8d6ee4e0afb881 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T07:27:21.973 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T07:27:22.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:22.017 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T07:27:22.018 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T07:27:22.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.11 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:22.046 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:21 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:21.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:22.354 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 systemd[1]: Stopping Ceph osd.11 for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:22.695 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.353+0000 7f8594666640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:22.695 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.353+0000 7f8594666640 -1 osd.11 96 *** Got signal Terminated *** 2024-09-19T07:27:22.696 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.353+0000 7f8594666640 -1 osd.11 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:27:23.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:23.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:23.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:23.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:23.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:23.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:23.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:22 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:22.805+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:24.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:24.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:24.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:24.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:24.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:24.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:24.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:23 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:23.780+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:25.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:25.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:25.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:25.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:25.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:25.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:25.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:25.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:24 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:24.813+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6820 osd.8 since back 2024-09-19T07:27:01.869933+0000 front 2024-09-19T07:27:01.869972+0000 (oldest deadline 2024-09-19T07:27:24.169930+0000) 2024-09-19T07:27:26.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:26.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:26.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:26.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:26.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:26.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:26.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:26.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:25 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:25.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6820 osd.8 since back 2024-09-19T07:27:01.869933+0000 front 2024-09-19T07:27:01.869972+0000 (oldest deadline 2024-09-19T07:27:24.169930+0000) 2024-09-19T07:27:27.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6806 osd.0 since back 2024-09-19T07:25:55.459075+0000 front 2024-09-19T07:25:55.459090+0000 (oldest deadline 2024-09-19T07:26:20.758933+0000) 2024-09-19T07:27:27.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6804 osd.2 since back 2024-09-19T07:26:11.860714+0000 front 2024-09-19T07:26:11.860741+0000 (oldest deadline 2024-09-19T07:26:35.360850+0000) 2024-09-19T07:27:27.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6814 osd.3 since back 2024-09-19T07:26:20.662043+0000 front 2024-09-19T07:26:20.662067+0000 (oldest deadline 2024-09-19T07:26:45.362124+0000) 2024-09-19T07:27:27.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6812 osd.4 since back 2024-09-19T07:26:25.863584+0000 front 2024-09-19T07:26:25.863411+0000 (oldest deadline 2024-09-19T07:26:51.163487+0000) 2024-09-19T07:27:27.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6812 osd.5 since back 2024-09-19T07:26:38.566763+0000 front 2024-09-19T07:26:38.566525+0000 (oldest deadline 2024-09-19T07:27:03.266619+0000) 2024-09-19T07:27:27.195 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.29:6822 osd.6 since back 2024-09-19T07:26:43.267167+0000 front 2024-09-19T07:26:43.267220+0000 (oldest deadline 2024-09-19T07:27:09.167093+0000) 2024-09-19T07:27:27.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.46:6820 osd.7 since back 2024-09-19T07:26:53.168672+0000 front 2024-09-19T07:26:53.168717+0000 (oldest deadline 2024-09-19T07:27:20.768947+0000) 2024-09-19T07:27:27.196 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:26 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11[60062]: 2024-09-19T07:27:26.863+0000 7f858cc74640 -1 osd.11 96 heartbeat_check: no reply from 172.21.15.78:6820 osd.8 since back 2024-09-19T07:27:01.869933+0000 front 2024-09-19T07:27:01.869972+0000 (oldest deadline 2024-09-19T07:27:24.169930+0000) 2024-09-19T07:27:28.322 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:28 smithi078 podman[70647]: 2024-09-19 07:27:28.031558732 +0000 UTC m=+5.818086451 container died dd0ca43d5d08c10b916b4057d452cff92d507defbffc857b3480bcef3da9ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:27:28.688 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:28 smithi078 podman[70647]: 2024-09-19 07:27:28.412239912 +0000 UTC m=+6.198767640 container cleanup dd0ca43d5d08c10b916b4057d452cff92d507defbffc857b3480bcef3da9ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:27:28.688 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:28 smithi078 bash[70647]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11 2024-09-19T07:27:28.945 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:28 smithi078 podman[70662]: 2024-09-19 07:27:28.688406749 +0000 UTC m=+0.648429857 container remove dd0ca43d5d08c10b916b4057d452cff92d507defbffc857b3480bcef3da9ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:27:29.283 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:28 smithi078 podman[70753]: 2024-09-19 07:27:28.899719629 +0000 UTC m=+0.015687547 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:27:29.283 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:29 smithi078 podman[70753]: 2024-09-19 07:27:29.005919884 +0000 UTC m=+0.121887835 container create b38300dae264e9d9fbd3f72cb7112f055c98b1430b0dd2ddee13ce36fcefcc47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:27:29.283 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:29 smithi078 podman[70753]: 2024-09-19 07:27:29.200000439 +0000 UTC m=+0.315968356 container init b38300dae264e9d9fbd3f72cb7112f055c98b1430b0dd2ddee13ce36fcefcc47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T07:27:29.283 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:29 smithi078 podman[70753]: 2024-09-19 07:27:29.203117289 +0000 UTC m=+0.319085199 container start b38300dae264e9d9fbd3f72cb7112f055c98b1430b0dd2ddee13ce36fcefcc47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T07:27:29.283 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:29 smithi078 podman[70753]: 2024-09-19 07:27:29.283164876 +0000 UTC m=+0.399132789 container attach b38300dae264e9d9fbd3f72cb7112f055c98b1430b0dd2ddee13ce36fcefcc47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T07:27:29.678 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:29 smithi078 podman[70753]: 2024-09-19 07:27:29.394309227 +0000 UTC m=+0.510277136 container died b38300dae264e9d9fbd3f72cb7112f055c98b1430b0dd2ddee13ce36fcefcc47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:27:29.929 INFO:journalctl@ceph.osd.11.smithi078.stdout:Sep 19 07:27:29 smithi078 podman[70776]: 2024-09-19 07:27:29.928004311 +0000 UTC m=+0.527027240 container remove b38300dae264e9d9fbd3f72cb7112f055c98b1430b0dd2ddee13ce36fcefcc47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:27:29.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T07:27:30.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:30.030 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T07:27:30.031 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T07:27:30.031 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.a 2024-09-19T07:27:30.346 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:30 smithi029 systemd[1]: Stopping Ceph mds.a for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:30.623 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:30 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a[72512]: 2024-09-19T07:27:30.346+0000 7fb575a3b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:30.623 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:30 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a[72512]: 2024-09-19T07:27:30.346+0000 7fb575a3b640 -1 mds.a *** got signal Terminated *** 2024-09-19T07:27:32.306 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:31 smithi029 podman[96283]: 2024-09-19 07:27:31.998642673 +0000 UTC m=+1.754255588 container died b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:27:32.623 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:32 smithi029 podman[96283]: 2024-09-19 07:27:32.414560462 +0000 UTC m=+2.170173373 container cleanup b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:27:32.624 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:32 smithi029 bash[96283]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a 2024-09-19T07:27:32.870 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T07:27:32.892 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:32 smithi029 podman[96295]: 2024-09-19 07:27:32.641826533 +0000 UTC m=+0.635965834 container remove b39e59c34ce61d5e48f3a87ac81604ac90f3975f56cf215982fd2fed81bb1277 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:27:32.892 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:32 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-19T07:27:32.892 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:32 smithi029 systemd[1]: Stopped Ceph mds.a for 6a046fca-7654-11ef-bceb-c7b262605968. 2024-09-19T07:27:32.893 INFO:journalctl@ceph.mds.a.smithi029.stdout:Sep 19 07:27:32 smithi029 systemd[1]: ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.a.service: Consumed 1.132s CPU time. 2024-09-19T07:27:32.905 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:32.906 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T07:27:32.906 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T07:27:32.906 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.d 2024-09-19T07:27:33.230 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:27:32 smithi029 systemd[1]: Stopping Ceph mds.d for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:33.623 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:27:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d[71327]: 2024-09-19T07:27:33.230+0000 7f8858b4b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:33.624 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:27:33 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d[71327]: 2024-09-19T07:27:33.230+0000 7f8858b4b640 -1 mds.d *** got signal Terminated *** 2024-09-19T07:27:36.501 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:27:36 smithi029 podman[96404]: 2024-09-19 07:27:36.200089922 +0000 UTC m=+3.068806583 container died a662b06beb8d290f3d14dbda7cd57883e092c95477904e33cbe4c5dd70aefce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T07:27:36.873 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:27:36 smithi029 podman[96404]: 2024-09-19 07:27:36.598898574 +0000 UTC m=+3.467615243 container cleanup a662b06beb8d290f3d14dbda7cd57883e092c95477904e33cbe4c5dd70aefce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:27:36.873 INFO:journalctl@ceph.mds.d.smithi029.stdout:Sep 19 07:27:36 smithi029 bash[96404]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-d 2024-09-19T07:27:37.041 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T07:27:37.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:37.075 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T07:27:37.075 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T07:27:37.075 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.g 2024-09-19T07:27:37.422 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:37 smithi029 systemd[1]: Stopping Ceph mds.g for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:37.873 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g[72117]: 2024-09-19T07:27:37.422+0000 7f6f5a84b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:37.873 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:37 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g[72117]: 2024-09-19T07:27:37.422+0000 7f6f5a84b640 -1 mds.g *** got signal Terminated *** 2024-09-19T07:27:40.373 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:40 smithi029 podman[96525]: 2024-09-19 07:27:40.101637087 +0000 UTC m=+2.796239692 container died 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T07:27:40.743 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:40 smithi029 podman[96525]: 2024-09-19 07:27:40.515783829 +0000 UTC m=+3.210386428 container cleanup 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:27:40.743 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:40 smithi029 bash[96525]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g 2024-09-19T07:27:41.001 INFO:journalctl@ceph.mds.g.smithi029.stdout:Sep 19 07:27:40 smithi029 podman[96539]: 2024-09-19 07:27:40.743271151 +0000 UTC m=+0.635238480 container remove 31e3e9258d6591a297aa44c8cafd80548c6595c00f92631fb91a34da5c711eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T07:27:41.005 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T07:27:41.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:41.038 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T07:27:41.038 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T07:27:41.039 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.j 2024-09-19T07:27:41.348 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:27:41 smithi029 systemd[1]: Stopping Ceph mds.j for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:41.623 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:27:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j[70914]: 2024-09-19T07:27:41.348+0000 7f43383dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:41.623 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:27:41 smithi029 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j[70914]: 2024-09-19T07:27:41.348+0000 7f43383dc640 -1 mds.j *** got signal Terminated *** 2024-09-19T07:27:45.019 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:27:44 smithi029 podman[96646]: 2024-09-19 07:27:44.720561463 +0000 UTC m=+3.459969061 container died 5c3613ca38cb0fd0ba7e89e2dcafd916b9d949fbb6c9f61aa21fec9894fc5b3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:27:45.352 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:27:45 smithi029 podman[96646]: 2024-09-19 07:27:45.092141576 +0000 UTC m=+3.831549171 container cleanup 5c3613ca38cb0fd0ba7e89e2dcafd916b9d949fbb6c9f61aa21fec9894fc5b3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T07:27:45.352 INFO:journalctl@ceph.mds.j.smithi029.stdout:Sep 19 07:27:45 smithi029 bash[96646]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-j 2024-09-19T07:27:45.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T07:27:45.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:45.513 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T07:27:45.513 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T07:27:45.513 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.b 2024-09-19T07:27:45.827 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:27:45 smithi046 systemd[1]: Stopping Ceph mds.b for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:46.224 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:27:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b[63680]: 2024-09-19T07:27:45.827+0000 7fc6fb507640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:46.225 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:27:45 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b[63680]: 2024-09-19T07:27:45.827+0000 7fc6fb507640 -1 mds.b *** got signal Terminated *** 2024-09-19T07:27:47.224 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:27:46 smithi046 podman[69640]: 2024-09-19 07:27:46.972300177 +0000 UTC m=+1.250931822 container died 82e462d0dd6a17e787a1990e013294d5d966f493d4da0932a4e60b8d60403c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T07:27:47.702 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:27:47 smithi046 podman[69640]: 2024-09-19 07:27:47.468714013 +0000 UTC m=+1.747345660 container cleanup 82e462d0dd6a17e787a1990e013294d5d966f493d4da0932a4e60b8d60403c4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T07:27:47.703 INFO:journalctl@ceph.mds.b.smithi046.stdout:Sep 19 07:27:47 smithi046 bash[69640]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-b 2024-09-19T07:27:47.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T07:27:47.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:47.873 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T07:27:47.873 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T07:27:47.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.e 2024-09-19T07:27:48.207 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:27:47 smithi046 systemd[1]: Stopping Ceph mds.e for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:48.474 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:27:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e[63071]: 2024-09-19T07:27:48.206+0000 7fd0d12c3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:48.475 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:27:48 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e[63071]: 2024-09-19T07:27:48.206+0000 7fd0d12c3640 -1 mds.e *** got signal Terminated *** 2024-09-19T07:27:51.208 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:27:50 smithi046 podman[69774]: 2024-09-19 07:27:50.924335277 +0000 UTC m=+2.826345379 container died 62571f68296a6ebbc0be1b6b2418ba9247182ecc2187cd625d75d1b9cd56b595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:27:51.475 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:27:51 smithi046 podman[69774]: 2024-09-19 07:27:51.289231269 +0000 UTC m=+3.191241370 container cleanup 62571f68296a6ebbc0be1b6b2418ba9247182ecc2187cd625d75d1b9cd56b595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T07:27:51.475 INFO:journalctl@ceph.mds.e.smithi046.stdout:Sep 19 07:27:51 smithi046 bash[69774]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-e 2024-09-19T07:27:51.724 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T07:27:51.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:51.761 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T07:27:51.761 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T07:27:51.761 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.h 2024-09-19T07:27:52.093 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:27:51 smithi046 systemd[1]: Stopping Ceph mds.h for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:52.475 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:27:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h[63376]: 2024-09-19T07:27:52.092+0000 7fa0cdd20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:52.475 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:27:52 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h[63376]: 2024-09-19T07:27:52.092+0000 7fa0cdd20640 -1 mds.h *** got signal Terminated *** 2024-09-19T07:27:55.085 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:27:54 smithi046 podman[69894]: 2024-09-19 07:27:54.798361659 +0000 UTC m=+2.815393309 container died 9718e73b2eaf075b92778f278a5ab8b13ce3f392032a76760c93ae1f1027df4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T07:27:55.468 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:27:55 smithi046 podman[69894]: 2024-09-19 07:27:55.184318688 +0000 UTC m=+3.201350335 container cleanup 9718e73b2eaf075b92778f278a5ab8b13ce3f392032a76760c93ae1f1027df4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T07:27:55.468 INFO:journalctl@ceph.mds.h.smithi046.stdout:Sep 19 07:27:55 smithi046 bash[69894]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-h 2024-09-19T07:27:55.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T07:27:55.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:55.660 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T07:27:55.660 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T07:27:55.660 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.k 2024-09-19T07:27:55.975 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:27:55 smithi046 systemd[1]: Stopping Ceph mds.k for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:56.475 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:27:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k[62753]: 2024-09-19T07:27:56.003+0000 7f86104a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:56.476 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:27:56 smithi046 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k[62753]: 2024-09-19T07:27:56.003+0000 7f86104a4640 -1 mds.k *** got signal Terminated *** 2024-09-19T07:27:58.031 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:27:57 smithi046 podman[70014]: 2024-09-19 07:27:57.778782536 +0000 UTC m=+1.887202602 container died 74e5726e7fbc3b6e7a8f4612bb599cbcaa3a79951fa4cfa8f78be155789b6c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T07:27:58.422 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:27:58 smithi046 podman[70014]: 2024-09-19 07:27:58.163361526 +0000 UTC m=+2.271781585 container cleanup 74e5726e7fbc3b6e7a8f4612bb599cbcaa3a79951fa4cfa8f78be155789b6c72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:27:58.422 INFO:journalctl@ceph.mds.k.smithi046.stdout:Sep 19 07:27:58 smithi046 bash[70014]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-k 2024-09-19T07:27:58.553 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T07:27:58.586 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:27:58.587 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T07:27:58.587 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T07:27:58.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.c 2024-09-19T07:27:58.912 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:27:58 smithi078 systemd[1]: Stopping Ceph mds.c for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:27:59.195 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:27:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c[64879]: 2024-09-19T07:27:58.911+0000 7fc9447ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:27:59.195 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:27:58 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c[64879]: 2024-09-19T07:27:58.911+0000 7fc9447ef640 -1 mds.c *** got signal Terminated *** 2024-09-19T07:28:00.195 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:28:00 smithi078 podman[70855]: 2024-09-19 07:28:00.078045934 +0000 UTC m=+1.289556536 container died e501614f88394098e5119773397486913ff5a5b5634bd24480602650dd841f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:28:00.445 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:28:00 smithi078 podman[70855]: 2024-09-19 07:28:00.436741979 +0000 UTC m=+1.648252582 container cleanup e501614f88394098e5119773397486913ff5a5b5634bd24480602650dd841f3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:28:00.445 INFO:journalctl@ceph.mds.c.smithi078.stdout:Sep 19 07:28:00 smithi078 bash[70855]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-c 2024-09-19T07:28:00.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T07:28:00.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:28:00.952 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T07:28:00.952 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T07:28:00.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.f 2024-09-19T07:28:01.299 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:28:01 smithi078 systemd[1]: Stopping Ceph mds.f for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:28:01.695 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:28:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-f[64581]: 2024-09-19T07:28:01.298+0000 7facf7513640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:28:01.695 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:28:01 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-f[64581]: 2024-09-19T07:28:01.298+0000 7facf7513640 -1 mds.f *** got signal Terminated *** 2024-09-19T07:28:05.808 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:28:05 smithi078 podman[70987]: 2024-09-19 07:28:05.44653661 +0000 UTC m=+4.261272561 container died c117347196f49fb6b988317e91249dfad69b5a801f77bc02e890f525c147594a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:28:06.195 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:28:05 smithi078 podman[70987]: 2024-09-19 07:28:05.906976425 +0000 UTC m=+4.721712376 container cleanup c117347196f49fb6b988317e91249dfad69b5a801f77bc02e890f525c147594a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:28:06.195 INFO:journalctl@ceph.mds.f.smithi078.stdout:Sep 19 07:28:05 smithi078 bash[70987]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-f 2024-09-19T07:28:06.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T07:28:06.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:28:06.355 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T07:28:06.355 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T07:28:06.355 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.i 2024-09-19T07:28:06.683 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:28:06 smithi078 systemd[1]: Stopping Ceph mds.i for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:28:06.945 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:28:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: 2024-09-19T07:28:06.682+0000 7f3ed3ab7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:28:06.945 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:28:06 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i[65181]: 2024-09-19T07:28:06.682+0000 7f3ed3ab7640 -1 mds.i *** got signal Terminated *** 2024-09-19T07:28:10.945 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:28:10 smithi078 podman[71107]: 2024-09-19 07:28:10.697630512 +0000 UTC m=+4.130001746 container died 0b9f4cc07f7d627b9ba89223a2104df8f91a7a174d8e129be6d53ca71ed6a9e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T07:28:11.428 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:28:11 smithi078 podman[71107]: 2024-09-19 07:28:11.177360263 +0000 UTC m=+4.609731497 container cleanup 0b9f4cc07f7d627b9ba89223a2104df8f91a7a174d8e129be6d53ca71ed6a9e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:28:11.429 INFO:journalctl@ceph.mds.i.smithi078.stdout:Sep 19 07:28:11 smithi078 bash[71107]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-i 2024-09-19T07:28:11.554 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T07:28:11.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:28:11.588 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T07:28:11.588 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T07:28:11.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.l 2024-09-19T07:28:11.695 INFO:journalctl@ceph.mds.l.smithi078.stdout:Sep 19 07:28:11 smithi078 systemd[1]: Stopping Ceph mds.l for 6a046fca-7654-11ef-bceb-c7b262605968... 2024-09-19T07:28:12.195 INFO:journalctl@ceph.mds.l.smithi078.stdout:Sep 19 07:28:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-l[64266]: 2024-09-19T07:28:11.922+0000 7f8bd48fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:28:12.195 INFO:journalctl@ceph.mds.l.smithi078.stdout:Sep 19 07:28:11 smithi078 ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-l[64266]: 2024-09-19T07:28:11.922+0000 7f8bd48fe640 -1 mds.l *** got signal Terminated *** 2024-09-19T07:28:15.315 INFO:journalctl@ceph.mds.l.smithi078.stdout:Sep 19 07:28:15 smithi078 podman[71228]: 2024-09-19 07:28:15.026646551 +0000 UTC m=+3.224752653 container died 3943bc697b52f1493d0138126a66eb8839b9ba2251935797b27b42ecf091df10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T07:28:15.695 INFO:journalctl@ceph.mds.l.smithi078.stdout:Sep 19 07:28:15 smithi078 podman[71228]: 2024-09-19 07:28:15.398150042 +0000 UTC m=+3.596256145 container cleanup 3943bc697b52f1493d0138126a66eb8839b9ba2251935797b27b42ecf091df10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T07:28:15.696 INFO:journalctl@ceph.mds.l.smithi078.stdout:Sep 19 07:28:15 smithi078 bash[71228]: ceph-6a046fca-7654-11ef-bceb-c7b262605968-mds-l 2024-09-19T07:28:15.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6a046fca-7654-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T07:28:15.884 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:28:15.884 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T07:28:15.884 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:28:16.097 INFO:teuthology.orchestra.run.smithi029.stdout:Deleting cluster with fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:28:18.749 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:28:18.970 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:28:21.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:28:21.868 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T07:28:24.308 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:28:24.344 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:28:24.379 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:28:24.405 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T07:28:24.407 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi029/crash 2024-09-19T07:28:24.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:28:24.457 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:28:24.457 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:28:24.459 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi046/crash 2024-09-19T07:28:24.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:28:24.535 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:28:24.536 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:28:24.538 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi078/crash 2024-09-19T07:28:24.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:28:24.579 INFO:teuthology.orchestra.run.smithi078.stderr:tar: /var/lib/ceph/6a046fca-7654-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:28:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:28:24.581 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T07:28:24.581 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T07:28:24.713 INFO:tasks.cephadm:Compressing logs... 2024-09-19T07:28:24.713 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:28:24.716 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:28:24.718 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:28:24.749 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T07:28:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-19T07:28:24.753 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T07:28:24.754 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T07:28:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:28:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:28:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T07:28:24.755 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:28:24.756 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T07:28:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T07:28:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T07:28:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.a.log: /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:28:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T07:28:24.757 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T07:28:24.760 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T07:28:24.760 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T07:28:24.760 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T07:28:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:28:24.761 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T07:28:24.761 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr: -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:28:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T07:28:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:28:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T07:28:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T07:28:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T07:28:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:28:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T07:28:24.767 INFO:teuthology.orchestra.run.smithi029.stderr: 94.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T07:28:24.767 INFO:teuthology.orchestra.run.smithi029.stderr: 94.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T07:28:24.767 INFO:teuthology.orchestra.run.smithi029.stderr: 94.7% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T07:28:24.767 INFO:teuthology.orchestra.run.smithi029.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-19T07:28:24.770 INFO:teuthology.orchestra.run.smithi078.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.11.log: /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.8.log/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log: 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T07:28:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T07:28:24.772 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:28:24.772 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T07:28:24.772 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T07:28:24.902 INFO:teuthology.orchestra.run.smithi078.stderr: 82.6% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:28:24.921 INFO:teuthology.orchestra.run.smithi078.stderr: 94.6% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T07:28:24.928 INFO:teuthology.orchestra.run.smithi029.stderr: 82.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:28:24.929 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T07:28:24.944 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:28:24.944 INFO:teuthology.orchestra.run.smithi078.stderr: 93.2% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T07:28:24.958 INFO:teuthology.orchestra.run.smithi046.stderr: 82.7% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:28:24.958 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:28:24.965 INFO:teuthology.orchestra.run.smithi046.stderr: 94.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T07:28:24.974 INFO:teuthology.orchestra.run.smithi046.stderr: 87.3% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:28:24.977 INFO:teuthology.orchestra.run.smithi046.stderr: 93.1% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T07:28:24.999 INFO:teuthology.orchestra.run.smithi046.stderr: 90.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:28:25.018 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:28:25.050 INFO:teuthology.orchestra.run.smithi078.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:28:25.053 INFO:teuthology.orchestra.run.smithi029.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:28:25.091 INFO:teuthology.orchestra.run.smithi029.stderr: 90.3% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:28:25.166 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:28:25.169 INFO:teuthology.orchestra.run.smithi029.stderr: 90.9% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:28:26.370 INFO:teuthology.orchestra.run.smithi046.stderr: 91.0% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:28:27.677 INFO:teuthology.orchestra.run.smithi029.stderr: 90.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T07:28:28.559 INFO:teuthology.orchestra.run.smithi046.stderr: 95.7% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T07:28:28.789 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T07:28:31.593 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T07:28:53.164 INFO:teuthology.orchestra.run.smithi029.stderr: 90.3% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T07:33:21.309 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T07:36:38.200 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T07:36:54.457 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T07:37:14.511 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T07:37:18.427 INFO:teuthology.orchestra.run.smithi046.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T07:37:18.429 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-19T07:37:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:real 8m53.695s 2024-09-19T07:37:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:user 6m19.705s 2024-09-19T07:37:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m13.216s 2024-09-19T07:40:19.926 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T07:40:22.649 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T07:43:23.995 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T07:43:52.710 INFO:teuthology.orchestra.run.smithi078.stderr: 90.7% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T07:43:52.712 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-19T07:43:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:real 15m27.979s 2024-09-19T07:43:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:user 6m45.381s 2024-09-19T07:43:52.712 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m17.465s 2024-09-19T07:54:18.265 INFO:teuthology.orchestra.run.smithi029.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T07:55:20.591 INFO:teuthology.orchestra.run.smithi029.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T07:56:41.040 INFO:teuthology.orchestra.run.smithi029.stderr: 90.7% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T07:56:49.061 INFO:teuthology.orchestra.run.smithi029.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T07:58:02.180 INFO:teuthology.orchestra.run.smithi029.stderr: 90.8% -- replaced with /var/log/ceph/6a046fca-7654-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T07:58:02.182 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-19T07:58:02.182 INFO:teuthology.orchestra.run.smithi029.stderr:real 29m37.451s 2024-09-19T07:58:02.182 INFO:teuthology.orchestra.run.smithi029.stderr:user 10m1.689s 2024-09-19T07:58:02.182 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m28.493s 2024-09-19T07:58:02.183 INFO:tasks.cephadm:Archiving logs... 2024-09-19T07:58:02.184 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi029/log 2024-09-19T07:58:02.185 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:59:38.739 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi046/log 2024-09-19T07:59:38.740 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:00:44.001 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi078/log 2024-09-19T08:00:44.008 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T08:01:55.377 INFO:tasks.cephadm:Removing cluster... 2024-09-19T08:01:55.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --force 2024-09-19T08:01:56.137 INFO:teuthology.orchestra.run.smithi029.stdout:Deleting cluster with fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T08:01:56.974 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --force 2024-09-19T08:01:57.468 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T08:01:58.184 DEBUG:teuthology.orchestra.run.smithi078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6a046fca-7654-11ef-bceb-c7b262605968 --force 2024-09-19T08:01:58.652 INFO:teuthology.orchestra.run.smithi078.stdout:Deleting cluster with fsid: 6a046fca-7654-11ef-bceb-c7b262605968 2024-09-19T08:01:59.411 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T08:01:59.411 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:01:59.432 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:01:59.452 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T08:01:59.469 INFO:tasks.cephadm:Teardown complete 2024-09-19T08:01:59.469 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T08:01:59.481 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T08:01:59.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:01:59.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:01:59.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T08:01:59.617 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T08:01:59.625 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T08:01:59.626 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:01:59.629 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:01:59.631 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:01:59.643 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:01:59.645 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:01:59.646 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:01:59.672 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:01:59.672 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-19T08:01:59.672 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +1434us[+1418us] +/- 66ms 2024-09-19T08:01:59.673 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -2832us[-2832us] +/- 58ms 2024-09-19T08:01:59.673 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +1543us[+1527us] +/- 73ms 2024-09-19T08:01:59.673 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:01:59.683 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:01:59.683 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-19T08:01:59.683 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +1484us[+1476us] +/- 66ms 2024-09-19T08:01:59.683 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -2791us[-2798us] +/- 58ms 2024-09-19T08:01:59.683 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +1589us[+1582us] +/- 73ms 2024-09-19T08:01:59.683 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:01:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:01:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-19T08:01:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +1482us[+1470us] +/- 66ms 2024-09-19T08:01:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -2798us[-2798us] +/- 58ms 2024-09-19T08:01:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 39 +1604us[+1604us] +/- 73ms 2024-09-19T08:01:59.691 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:01:59.692 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T08:01:59.700 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T08:01:59.701 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T08:01:59.710 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:01:59.892 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:01:59.990 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T08:02:00.098 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:02:00.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:02:00.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:02:00.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:02:00.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:02:00.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:02:00.193 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T08:02:00.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T08:02:00.214 INFO:teuthology.task.internal:Duration was 4235.428931 seconds 2024-09-19T08:02:00.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T08:02:00.225 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T08:02:00.225 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:02:00.228 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:02:00.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T08:02:00.291 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:02:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:02:00.298 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:02:00.793 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T08:02:00.793 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-09-19T08:02:00.793 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:02:00.829 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T08:02:00.829 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:02:00.861 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-19T08:02:00.861 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T08:02:00.906 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T08:02:00.906 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:02:00.909 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:02:00.912 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T08:02:00.974 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T08:02:00.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:02:00.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:02:00.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T08:02:01.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T08:02:01.508 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T08:02:01.509 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:02:01.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:02:01.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T08:02:01.617 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T08:02:01.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:02:01.633 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:02:01.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:02:01.660 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-09-19T08:02:01.665 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-09-19T08:02:01.689 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-19T08:02:01.714 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:02:01.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:02:01.740 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:02:01.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:02:01.756 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T08:02:01.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:02:01.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T08:02:01.788 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T08:02:01.790 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi029 2024-09-19T08:02:01.790 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:02:01.839 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi046 2024-09-19T08:02:01.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:02:01.881 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911773/remote/smithi078 2024-09-19T08:02:01.882 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T08:02:01.921 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T08:02:01.921 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:02:01.925 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:02:01.928 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T08:02:01.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T08:02:01.984 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T08:02:01.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T08:02:01.994 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T08:02:01.994 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:02:01.997 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:02:01.999 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T08:02:02.010 INFO:teuthology.orchestra.run.smithi029.stdout: 265546 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:02 /home/ubuntu/cephtest 2024-09-19T08:02:02.013 INFO:teuthology.orchestra.run.smithi046.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:02 /home/ubuntu/cephtest 2024-09-19T08:02:02.024 INFO:teuthology.orchestra.run.smithi078.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 08:02 /home/ubuntu/cephtest 2024-09-19T08:02:02.025 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T08:02:02.035 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T08:02:02.062 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} duration: 4235.42893075943 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T08:02:02.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:02:02.157 INFO:teuthology.run:pass